Nov 28 20:04:34 user devstack@n-api.service[65584]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 28 20:04:34 user devstack@n-api.service[65584]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Nov 28 20:04:34 2023] *** Nov 28 20:04:34 user devstack@n-api.service[65584]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Nov 28 20:04:34 user devstack@n-api.service[65584]: os: Linux-5.15.0-76-generic #83-Ubuntu SMP Thu Jun 15 19:16:32 UTC 2023 Nov 28 20:04:34 user devstack@n-api.service[65584]: nodename: user Nov 28 20:04:34 user devstack@n-api.service[65584]: machine: x86_64 Nov 28 20:04:34 user devstack@n-api.service[65584]: clock source: unix Nov 28 20:04:34 user devstack@n-api.service[65584]: pcre jit disabled Nov 28 20:04:34 user devstack@n-api.service[65584]: detected number of CPU cores: 12 Nov 28 20:04:34 user devstack@n-api.service[65584]: current working directory: / Nov 28 20:04:34 user devstack@n-api.service[65584]: detected binary path: /usr/bin/uwsgi-core Nov 28 20:04:34 user devstack@n-api.service[65584]: your processes number limit is 63589 Nov 28 20:04:34 user devstack@n-api.service[65584]: your memory page size is 4096 bytes Nov 28 20:04:34 user devstack@n-api.service[65584]: detected max file descriptor number: 2048 Nov 28 20:04:34 user devstack@n-api.service[65584]: lock engine: pthread robust mutexes Nov 28 20:04:34 user devstack@n-api.service[65584]: thunder lock: enabled Nov 28 20:04:34 user devstack@n-api.service[65584]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 28 20:04:34 user devstack@n-api.service[65584]: Python version: 3.10.12 (main, Nov 20 2023, 15:14:05) [GCC 11.4.0] Nov 28 20:04:34 user devstack@n-api.service[65584]: PEP 405 virtualenv detected: /opt/stack/data/venv Nov 28 20:04:34 user devstack@n-api.service[65584]: Set PythonHome to /opt/stack/data/venv Nov 28 20:04:34 user devstack@n-api.service[65584]: Python main interpreter initialized at 0x55e99f570b90 Nov 28 20:04:34 user devstack@n-api.service[65584]: python threads support enabled Nov 28 20:04:34 user devstack@n-api.service[65584]: your server socket listen backlog is limited to 100 connections Nov 28 20:04:34 user devstack@n-api.service[65584]: your mercy for graceful operations on workers is 80 seconds Nov 28 20:04:34 user devstack@n-api.service[65584]: mapped 537436 bytes (524 KB) for 3 cores Nov 28 20:04:34 user devstack@n-api.service[65584]: *** Operational MODE: preforking *** Nov 28 20:04:34 user devstack@n-api.service[65584]: *** uWSGI is running in multiple interpreter mode *** Nov 28 20:04:34 user devstack@n-api.service[65584]: spawned uWSGI master process (pid: 65584) Nov 28 20:04:34 user devstack@n-api.service[65584]: spawned uWSGI worker 1 (pid: 65585, cores: 1) Nov 28 20:04:34 user devstack@n-api.service[65584]: spawned uWSGI worker 2 (pid: 65586, cores: 1) Nov 28 20:04:34 user devstack@n-api.service[65584]: spawned uWSGI worker 3 (pid: 65587, cores: 1) Nov 28 20:04:34 user devstack@n-api.service[65584]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_green_pool_size = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 120 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 720 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 20:04:38 user devstack@n-api.service[65587]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 20:04:38 user devstack@n-api.service[65587]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 20:04:38 user devstack@n-api.service[65587]: and ``live_migration_inbound_addr`` respectively. Nov 28 20:04:38 user devstack@n-api.service[65587]: ). Its value may be silently ignored in the future. Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 20:04:38 user devstack@n-api.service[65586]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 20:04:38 user devstack@n-api.service[65586]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 20:04:38 user devstack@n-api.service[65586]: and ``live_migration_inbound_addr`` respectively. Nov 28 20:04:38 user devstack@n-api.service[65586]: ). Its value may be silently ignored in the future. Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.conductor_group = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_path = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.auth_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Nov 28 20:04:38 user devstack@n-api.service[65585]: live_migration_uri is deprecated for removal in favor of two other options that Nov 28 20:04:38 user devstack@n-api.service[65585]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Nov 28 20:04:38 user devstack@n-api.service[65585]: and ``live_migration_inbound_addr`` respectively. Nov 28 20:04:38 user devstack@n-api.service[65585]: ). Its value may be silently ignored in the future. Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tb_cache_size = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65587) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65586) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65586]: INFO dbcounter [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Registered counter for database nova_api Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: INFO dbcounter [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Registered counter for database nova_api Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_requests = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.process_tags = {} {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler_jaeger.service_name_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] profiler_otlp.service_name_prefix = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_db.sqlalchemy.engines [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=65585) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_db.sqlalchemy.engines [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writer thread running {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writer thread running {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG nova.context [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88105936-ce3a-426e-b16b-d7ab0f9004ae(cell1) {{(pid=65587) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG nova.context [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88105936-ce3a-426e-b16b-d7ab0f9004ae(cell1) {{(pid=65586) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 20:04:38 user devstack@n-api.service[65587]: INFO dbcounter [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Registered counter for database nova_cell0 Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65587]: INFO dbcounter [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Registered counter for database nova_cell1 Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65586]: INFO dbcounter [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Registered counter for database nova_cell0 Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_db.sqlalchemy.engines [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65586]: INFO dbcounter [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Registered counter for database nova_cell1 Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writer thread running {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_db.sqlalchemy.engines [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writer thread running {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_db.sqlalchemy.engines [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65585]: INFO dbcounter [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Registered counter for database nova_api Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_db.sqlalchemy.engines [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writer thread running {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_db.sqlalchemy.engines [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writer thread running {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG nova.context [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88105936-ce3a-426e-b16b-d7ab0f9004ae(cell1) {{(pid=65585) load_cells /opt/stack/nova/nova/context.py:464}} Nov 28 20:04:38 user devstack@n-api.service[65587]: INFO dbcounter [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Registered counter for database nova_cell0 Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writer thread running {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG oslo_db.sqlalchemy.engines [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65587) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65585]: INFO dbcounter [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Registered counter for database nova_cell0 Nov 28 20:04:38 user devstack@n-api.service[65586]: INFO dbcounter [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Registered counter for database nova_cell0 Nov 28 20:04:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writer thread running {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65585]: INFO dbcounter [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Registered counter for database nova_cell1 Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG oslo_db.sqlalchemy.engines [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65586) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writer thread running {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_db.sqlalchemy.engines [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writer thread running {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:38 user devstack@n-api.service[65585]: DEBUG oslo_db.sqlalchemy.engines [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writer thread running {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:39 user devstack@n-api.service[65585]: INFO dbcounter [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Registered counter for database nova_cell0 Nov 28 20:04:39 user devstack@n-api.service[65585]: DEBUG oslo_db.sqlalchemy.engines [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:342}} Nov 28 20:04:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writer thread running {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Nov 28 20:04:39 user devstack@n-api.service[65587]: WARNING keystonemiddleware.auth_token [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65587]: WARNING keystonemiddleware.auth_token [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65585]: WARNING keystonemiddleware.auth_token [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65585]: WARNING keystonemiddleware.auth_token [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65586]: WARNING keystonemiddleware.auth_token [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65586]: WARNING keystonemiddleware.auth_token [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65587]: WARNING keystonemiddleware.auth_token [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65587]: WARNING keystonemiddleware.auth_token [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65587]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e99f570b90 pid: 65587 (default app) Nov 28 20:04:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:04:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001759 Nov 28 20:04:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Nov 28 20:04:39 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:04:39 user devstack@n-api.service[65586]: WARNING keystonemiddleware.auth_token [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65586]: WARNING keystonemiddleware.auth_token [None req-16b817cf-5254-4827-a8e8-99bdd18cf948 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e99f570b90 pid: 65586 (default app) Nov 28 20:04:39 user devstack@n-api.service[65585]: WARNING keystonemiddleware.auth_token [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 28 20:04:39 user devstack@n-api.service[65585]: WARNING keystonemiddleware.auth_token [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 28 20:04:39 user devstack@n-api.service[65585]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e99f570b90 pid: 65585 (default app) Nov 28 20:06:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cd0f19b6-46d9-4d71-b7f3-ac2ebe7102cc None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001522 Nov 28 20:06:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:49 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d20e6091-9ca1-473f-b0d0-d1e66bf06a0d admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d20e6091-9ca1-473f-b0d0-d1e66bf06a0d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.454500 Nov 28 20:06:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 20:06:49 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:06:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002692 Nov 28 20:06:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:51 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:06:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-fcf555f5-1766-496f-8800-affb89c88283 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "name": "cirros256"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-fcf555f5-1766-496f-8800-affb89c88283 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.393347 Nov 28 20:06:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:06:51 2023] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:06:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2cb51806-1238-4c07-8659-130815a046e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2cb51806-1238-4c07-8659-130815a046e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041952 Nov 28 20:06:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 20:06:51 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:06:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001461 Nov 28 20:06:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:53 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c3f0e9d7-85d2-460e-be76-5e118477ae3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d1", "disk": 5, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "name": "ds512M", "ram": 512}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c3f0e9d7-85d2-460e-be76-5e118477ae3a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064561 Nov 28 20:06:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:06:53 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:06:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-35dbb9be-b98e-4011-b949-2fbd794f1d76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-35dbb9be-b98e-4011-b949-2fbd794f1d76 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023762 Nov 28 20:06:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 20:06:53 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:06:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.003159 Nov 28 20:06:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:55 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5a927a0e-0d0a-4c96-a53f-714ee2b78c68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5a927a0e-0d0a-4c96-a53f-714ee2b78c68 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.107221 Nov 28 20:06:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:06:55 2023] POST /compute/v2.1/flavors => generated 402 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:06:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ba7ef62d-98ca-463e-bc97-8cfe2eb3f7bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ba7ef62d-98ca-463e-bc97-8cfe2eb3f7bb admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025932 Nov 28 20:06:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 20:06:55 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:06:57 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001467 Nov 28 20:06:57 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:57 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e2f78c59-c8c7-48bc-acad-e1e0532acff4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "d3", "ram": 2048}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e2f78c59-c8c7-48bc-acad-e1e0532acff4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.066957 Nov 28 20:06:57 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:06:57 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:06:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c9089f87-a34b-4bb7-9456-4f91a6ccf23a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c9089f87-a34b-4bb7-9456-4f91a6ccf23a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023048 Nov 28 20:06:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 20:06:57 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:06:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:06:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001714 Nov 28 20:06:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:06:59 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:06:59 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cadf865a-15a7-4b5c-9b27-e8547d1af9c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 4, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:06:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cadf865a-15a7-4b5c-9b27-e8547d1af9c0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063451 Nov 28 20:06:59 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:06:59 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:06:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026278 Nov 28 20:07:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1330 bytes} [Tue Nov 28 20:06:59 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4f482dbd-f622-4807-9980-db76da8c6cb5 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001546 Nov 28 20:07:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:01 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3eac475d-7cc8-45ef-9d0e-111b283c980a admin admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3eac475d-7cc8-45ef-9d0e-111b283c980a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.084038 Nov 28 20:07:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1286 bytes} [Tue Nov 28 20:07:01 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:07:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001460 Nov 28 20:07:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:03 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:07:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:07:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:07:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:07:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a92efbb6-ac21-4071-93d2-8a3cb68ce6e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "swap": 0}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a92efbb6-ac21-4071-93d2-8a3cb68ce6e5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.323584 Nov 28 20:07:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:07:03 2023] POST /compute/v2.1/flavors => generated 400 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:07:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ce1f625c-da5b-412c-9ce2-22756db2571c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ce1f625c-da5b-412c-9ce2-22756db2571c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040613 Nov 28 20:07:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 20:07:04 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Nov 28 20:07:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f7475faa-3315-45d9-abc0-61948db74645 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "disk": 20, "name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f7475faa-3315-45d9-abc0-61948db74645 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068333 Nov 28 20:07:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:07:06 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:07:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ef7930ce-06e8-442e-9840-4c3102e44fc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ef7930ce-06e8-442e-9840-4c3102e44fc0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041840 Nov 28 20:07:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 20:07:06 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001312 Nov 28 20:07:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:08 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cf49b4ed-cd21-48af-9512-ddf193d229c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "disk": 40, "swap": 0, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cf49b4ed-cd21-48af-9512-ddf193d229c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.068021 Nov 28 20:07:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:07:08 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:07:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6b91b950-7dd8-42e3-b3f5-d1f7f89d6c87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6b91b950-7dd8-42e3-b3f5-d1f7f89d6c87 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025151 Nov 28 20:07:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 20:07:08 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:10 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:10 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001339 Nov 28 20:07:10 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3915a512-9536-42e7-8393-9f427f78b312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "name": "m1.large", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3915a512-9536-42e7-8393-9f427f78b312 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064209 Nov 28 20:07:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:07:10 2023] POST /compute/v2.1/flavors => generated 403 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:07:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d9961bd1-62d7-4a44-96db-94399fd78633 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d9961bd1-62d7-4a44-96db-94399fd78633 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024937 Nov 28 20:07:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 20:07:10 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001359 Nov 28 20:07:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 925 bytes} [Tue Nov 28 20:07:12 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:12 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-989795f4-6bed-4434-819f-b92c67bdccb9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "swap": 0, "name": "m1.xlarge"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-989795f4-6bed-4434-819f-b92c67bdccb9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.123936 Nov 28 20:07:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1277 bytes} [Tue Nov 28 20:07:12 2023] POST /compute/v2.1/flavors => generated 406 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:07:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-88bd93d8-61fc-46e1-8d2e-6420ecf83fef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:07:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-88bd93d8-61fc-46e1-8d2e-6420ecf83fef admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023542 Nov 28 20:07:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1327 bytes} [Tue Nov 28 20:07:12 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:07:44 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3e46463b-7137-41a9-a2d0-c8183b4ae5dd admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001454 Nov 28 20:07:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 20:07:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:07:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:07:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.096315 Nov 28 20:07:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1389 bytes} [Tue Nov 28 20:07:44 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:08:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-88bd93d8-61fc-46e1-8d2e-6420ecf83fef admin admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-88bd93d8-61fc-46e1-8d2e-6420ecf83fef admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002947 Nov 28 20:08:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 20:08:14 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:08:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:08:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-42359f63-5338-49f5-a203-abd5b2607f52 admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-42359f63-5338-49f5-a203-abd5b2607f52 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.112803 Nov 28 20:08:14 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1368 bytes} [Tue Nov 28 20:08:14 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:08:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bf0e690a-5c2c-41b0-9e49-eb63c2204dc4 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002300 Nov 28 20:08:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 20:08:17 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:08:17 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:08:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d5bc1364-e57f-48fa-87db-15d9982fc57b admin admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d5bc1364-e57f-48fa-87db-15d9982fc57b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 424 microversion: 2.61 time: 0.056319 Nov 28 20:08:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 15/41] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 20:08:17 2023] GET /compute/v2.1/flavors/1 => generated 424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:08:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-42359f63-5338-49f5-a203-abd5b2607f52 admin admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-42359f63-5338-49f5-a203-abd5b2607f52 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002256 Nov 28 20:08:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 14/42] 10.0.0.210 () {58 vars in 1007 bytes} [Tue Nov 28 20:08:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:08:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:08:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:08:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:08:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-10b78d4d-e840-4f58-97d4-e2361647429c admin admin] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:08:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-10b78d4d-e840-4f58-97d4-e2361647429c admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/2" status: 200 len: 427 microversion: 2.61 time: 0.071819 Nov 28 20:08:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 14/43] 10.0.0.210 () {64 vars in 1311 bytes} [Tue Nov 28 20:08:19 2023] GET /compute/v2.1/flavors/2 => generated 427 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:10:36 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:10:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-868cf08e-d908-4f4d-8f47-12e4ee816f4e tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Action: 'create', calling method: .version_select at 0x7f9e6555d990>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-352527869"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:37 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:10:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7d3540c7-a17f-4474-8c69-67c7dbb9fe98 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Action: 'create', calling method: .version_select at 0x7f9e65575ab0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-374936361", "metadata": {"Type": "work"}}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-868cf08e-d908-4f4d-8f47-12e4ee816f4e tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.520960 Nov 28 20:10:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 16/44] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Nov 28 20:10:36 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 1524 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 20:10:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8dc091d7-58dc-4923-ac63-80acbd2f75da tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e65543eb0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:38 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:10:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7d3540c7-a17f-4474-8c69-67c7dbb9fe98 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.049210 Nov 28 20:10:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 15/45] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 20:10:37 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1052 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Nov 28 20:10:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-49246bc8-d180-4fa6-8600-0253df8f677f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654ec670>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-49246bc8-d180-4fa6-8600-0253df8f677f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.065391 Nov 28 20:10:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 17/46] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:38 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8dc091d7-58dc-4923-ac63-80acbd2f75da tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.426561 Nov 28 20:10:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 15/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:37 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e2899163-1ff5-4768-ae2e-8d9eeb9d6928 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654d3640>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e2899163-1ff5-4768-ae2e-8d9eeb9d6928 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.067801 Nov 28 20:10:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:39 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-958da21d-0611-40bd-968a-4a5369b68cf2 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ecaf0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-958da21d-0611-40bd-968a-4a5369b68cf2 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.063002 Nov 28 20:10:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 18/49] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:39 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d50897d0-817d-44ea-bd48-a0489181ce9a tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654bc1f0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d50897d0-817d-44ea-bd48-a0489181ce9a tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 353 microversion: 2.1 time: 0.098202 Nov 28 20:10:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 16/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c4ee021f-e599-47dd-847d-16687b210288 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654d3a30>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c4ee021f-e599-47dd-847d-16687b210288 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 353 microversion: 2.1 time: 0.060356 Nov 28 20:10:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1a97752d-5509-4a95-bfce-fd8d51e9926f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654ecee0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-27763630-1e22-4469-b4ec-589ea9e17b1a tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530e050>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-27763630-1e22-4469-b4ec-589ea9e17b1a tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 345 microversion: 2.1 time: 0.070739 Nov 28 20:10:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-640523d5-6060-4b00-89f8-9de30c7c3444 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Action: 'create', calling method: .version_select at 0x7f9e65574af0>, body: {"snapshot": {"volume_id": "e32fa92d-a61c-40f6-a2ed-d40f138a137f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-425172745"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1a97752d-5509-4a95-bfce-fd8d51e9926f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 202 len: 0 microversion: 2.1 time: 0.106898 Nov 28 20:10:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:10:40 2023] DELETE /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e30fe4d3-cceb-4be0-b877-3c753ce087c6 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e65663c70>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e30fe4d3-cceb-4be0-b877-3c753ce087c6 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.057464 Nov 28 20:10:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-640523d5-6060-4b00-89f8-9de30c7c3444 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.234224 Nov 28 20:10:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 18/55] 10.0.0.210 () {64 vars in 1239 bytes} [Tue Nov 28 20:10:40 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-33e9fae2-65bd-42bd-be4f-fc89ce059fec tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ec9d0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-33e9fae2-65bd-42bd-be4f-fc89ce059fec tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.043881 Nov 28 20:10:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b8031514-b4df-4ecb-a6e4-4388a0f83835 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530e320>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b8031514-b4df-4ecb-a6e4-4388a0f83835 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.077847 Nov 28 20:10:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ba668e1b-4534-41d9-a410-d971b000ecc6 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654e8550>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ba668e1b-4534-41d9-a410-d971b000ecc6 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.039703 Nov 28 20:10:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:40 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0df577b9-3f49-4afa-b72c-b9585458be7f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654ed090>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0df577b9-3f49-4afa-b72c-b9585458be7f tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.063828 Nov 28 20:10:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:41 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ac311e77-6539-4ba0-979b-ab8a1d984491 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530f130>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ac311e77-6539-4ba0-979b-ab8a1d984491 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.059852 Nov 28 20:10:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:42 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3e3171d-cbd8-486a-bb0b-237cfc00fab6 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654d3910>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f3e3171d-cbd8-486a-bb0b-237cfc00fab6 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.068250 Nov 28 20:10:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:42 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a9a1b7e8-a9e7-430a-86f3-7863f2b3471a tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ed480>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a9a1b7e8-a9e7-430a-86f3-7863f2b3471a tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.042891 Nov 28 20:10:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:43 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ffa7ab28-9f5d-4cee-84e4-9c56c413d708 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e6530f010>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ffa7ab28-9f5d-4cee-84e4-9c56c413d708 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.049385 Nov 28 20:10:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 21/63] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:43 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:44 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-708af5b0-c560-4b04-b24f-01a966803429 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654d3be0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-708af5b0-c560-4b04-b24f-01a966803429 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 287 microversion: 2.1 time: 0.067182 Nov 28 20:10:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 21/64] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:44 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-92edc232-22be-42fb-b22c-41c629af3b9b tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ecf70>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-92edc232-22be-42fb-b22c-41c629af3b9b tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 202 len: 0 microversion: 2.1 time: 0.106976 Nov 28 20:10:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 23/65] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Nov 28 20:10:44 2023] DELETE /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:10:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4e033a3f-217d-45ca-aac9-057ba53a41fe tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530f0a0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4e033a3f-217d-45ca-aac9-057ba53a41fe tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.042193 Nov 28 20:10:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:44 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:10:44 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-49264631-8bbc-499e-b209-d80aeab00d4a tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654e8430>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-49264631-8bbc-499e-b209-d80aeab00d4a tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.058382 Nov 28 20:10:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 22/67] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:44 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-20c259c5-68f9-4a37-84cf-1692df3b1339 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ecb80>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-20c259c5-68f9-4a37-84cf-1692df3b1339 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.055380 Nov 28 20:10:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 24/68] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:45 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fce9eada-a3af-48fd-94ee-5df88b2eedcc tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e6530edd0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fce9eada-a3af-48fd-94ee-5df88b2eedcc tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 200 len: 352 microversion: 2.1 time: 0.239831 Nov 28 20:10:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 23/69] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:45 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 352 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-eb0804e4-3b2c-4289-b0dc-f9649c76362f tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654d3e20>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-eb0804e4-3b2c-4289-b0dc-f9649c76362f tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 200 len: 286 microversion: 2.1 time: 0.042261 Nov 28 20:10:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 23/70] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:46 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f67b1017-b72d-41fb-bb50-4dabe140c3b5 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Calling method '.version_select at 0x7f9e654ed630>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-f67b1017-b72d-41fb-bb50-4dabe140c3b5 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] HTTP exception thrown: Volume 4045e73e-751f-4ff1-adaf-e2ec3e0e4638 could not be found. Nov 28 20:10:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f67b1017-b72d-41fb-bb50-4dabe140c3b5 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] Returning 404 to user: Volume 4045e73e-751f-4ff1-adaf-e2ec3e0e4638 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f67b1017-b72d-41fb-bb50-4dabe140c3b5 tempest-VolumesGetTestJSON-820007059 tempest-VolumesGetTestJSON-820007059-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638" status: 404 len: 109 microversion: 2.1 time: 0.059187 Nov 28 20:10:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 25/71] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:47 2023] GET /compute/v2.1/os-volumes/4045e73e-751f-4ff1-adaf-e2ec3e0e4638 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e5fff77b-336a-4331-aa1b-8fc80a16f9c7 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530de10>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-e5fff77b-336a-4331-aa1b-8fc80a16f9c7 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] HTTP exception thrown: Snapshot 5eaa177f-b708-496f-a072-8089e39ad8f7 could not be found. Nov 28 20:10:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e5fff77b-336a-4331-aa1b-8fc80a16f9c7 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Returning 404 to user: Snapshot 5eaa177f-b708-496f-a072-8089e39ad8f7 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e5fff77b-336a-4331-aa1b-8fc80a16f9c7 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7" status: 404 len: 111 microversion: 2.1 time: 0.047055 Nov 28 20:10:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 24/72] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:10:47 2023] GET /compute/v2.1/os-snapshots/5eaa177f-b708-496f-a072-8089e39ad8f7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b606fd09-5b0f-43f3-b1a9-b9bd3a8a86d1 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654d3880>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b606fd09-5b0f-43f3-b1a9-b9bd3a8a86d1 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 202 len: 0 microversion: 2.1 time: 0.106774 Nov 28 20:10:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 24/73] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:10:47 2023] DELETE /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:10:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bee8b8d3-0218-47fd-9a9e-bd7df03def74 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e65ea24d0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bee8b8d3-0218-47fd-9a9e-bd7df03def74 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.074418 Nov 28 20:10:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 26/74] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:47 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-29bcf724-1c49-4c67-92d7-386edbaa712b tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e65e92830>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-29bcf724-1c49-4c67-92d7-386edbaa712b tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.072467 Nov 28 20:10:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:48 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-be597ae0-3ecb-4652-ae12-f07bf46fb227 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654e85e0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-be597ae0-3ecb-4652-ae12-f07bf46fb227 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.069025 Nov 28 20:10:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 25/76] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:49 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:50 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-89e1dcae-05bb-44fe-bd83-3c32dc59e9bb tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ec9d0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-89e1dcae-05bb-44fe-bd83-3c32dc59e9bb tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 200 len: 344 microversion: 2.1 time: 0.080075 Nov 28 20:10:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 27/77] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:50 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-86564dc1-7dfe-4557-80eb-fb791d7f7786 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e6530ed40>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-86564dc1-7dfe-4557-80eb-fb791d7f7786 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] HTTP exception thrown: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. Nov 28 20:10:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-86564dc1-7dfe-4557-80eb-fb791d7f7786 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Returning 404 to user: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-86564dc1-7dfe-4557-80eb-fb791d7f7786 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 404 len: 109 microversion: 2.1 time: 0.038414 Nov 28 20:10:52 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 26/78] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:52 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2e617370-6371-4489-a4c1-c29a58b24552 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654d3c70>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-2e617370-6371-4489-a4c1-c29a58b24552 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] HTTP exception thrown: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. Nov 28 20:10:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2e617370-6371-4489-a4c1-c29a58b24552 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Returning 404 to user: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2e617370-6371-4489-a4c1-c29a58b24552 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 404 len: 109 microversion: 2.1 time: 0.052252 Nov 28 20:10:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:10:52 2023] DELETE /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a0c16998-b677-468a-a2df-615a64bb2957 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Calling method '.version_select at 0x7f9e654ed5a0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-a0c16998-b677-468a-a2df-615a64bb2957 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] HTTP exception thrown: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. Nov 28 20:10:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a0c16998-b677-468a-a2df-615a64bb2957 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] Returning 404 to user: Volume e32fa92d-a61c-40f6-a2ed-d40f138a137f could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a0c16998-b677-468a-a2df-615a64bb2957 tempest-VolumesSnapshotsTestJSON-1583776036 tempest-VolumesSnapshotsTestJSON-1583776036-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f" status: 404 len: 109 microversion: 2.1 time: 0.036691 Nov 28 20:10:52 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 28/80] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:52 2023] GET /compute/v2.1/os-volumes/e32fa92d-a61c-40f6-a2ed-d40f138a137f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f50fee5e-93e1-403b-8302-7fa033e023f6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: .version_select at 0x7f9e6530f010>, body: {"keypair": {"name": "tempest-keypair-344088806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORLi9cBeKxwKZF2rkLIldgYbs91Se5SaovgAyOLlR1LAXkmJO85TwVIU01jacVfp8MokOP7s1wTMn2ItcMxD1z+b2y7pkirDp4yb/pOf68MDBPxyqhiOej8r0TiPf6AAg=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:54 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-f50fee5e-93e1-403b-8302-7fa033e023f6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:10:54 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-f50fee5e-93e1-403b-8302-7fa033e023f6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:10:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-89090598", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f50fee5e-93e1-403b-8302-7fa033e023f6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.512365 Nov 28 20:10:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 27/81] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:10:53 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:10:54 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] validate_networks() for [('0a497463-f8f1-4a9b-9a98-a2e6ca89c3c1', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:10:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ca9d9f39-e5e8-40b9-b079-c9080cf5246a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Action: 'create', calling method: .version_select at 0x7f9e65ea23b0>, body: {"keypair": {"name": "tempest-keypair-1302784070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6AuAWbbxZ0a6c7k1XS3X9t+pB3TAuStJooLKz16kYFR2aaVuQipo+CXoACBi2Birf2Rm15MEr9uQoGxphTgBDTn1HrWp9mOU4ZppNU69KCYDLZF6bXiACp5QJvGeeHcw=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:54 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-ca9d9f39-e5e8-40b9-b079-c9080cf5246a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for project fed1996731e94c8eb5c16e6327b32f39. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:10:54 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-ca9d9f39-e5e8-40b9-b079-c9080cf5246a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for user d313e776858a411ea463adecd1f36819 and project fed1996731e94c8eb5c16e6327b32f39. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:10:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ca9d9f39-e5e8-40b9-b079-c9080cf5246a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.93 time: 0.325766 Nov 28 20:10:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 29/82] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:10:54 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 327 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1af92181-d753-428e-9425-f556aa2d70d8 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Action: 'create', calling method: .version_select at 0x7f9e65663c70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-532355121", "metadata": {"Type": "work"}}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1af92181-d753-428e-9425-f556aa2d70d8 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1af92181-d753-428e-9425-f556aa2d70d8 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.334713 Nov 28 20:10:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 28/83] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 20:10:55 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-54652452-1cf9-4bec-84ae-ecda0c68385d tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Action: 'create', calling method: .version_select at 0x7f9e6555d990>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-118572375", "metadata": {"Type": "work"}}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-54652452-1cf9-4bec-84ae-ecda0c68385d tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-54652452-1cf9-4bec-84ae-ecda0c68385d tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009507 Nov 28 20:10:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 30/84] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 20:10:55 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-de6aed23-e1af-412f-a825-f5fd3605ddfd tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Action: 'create', calling method: .version_select at 0x7f9e65373be0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1844459969", "metadata": {"Type": "work"}}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-de6aed23-e1af-412f-a825-f5fd3605ddfd tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-de6aed23-e1af-412f-a825-f5fd3605ddfd tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015466 Nov 28 20:10:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Nov 28 20:10:55 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bca01dec-0b97-4004-b874-b5d4f03a1727 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Calling method '.version_select at 0x7f9e654ecd30>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-bca01dec-0b97-4004-b874-b5d4f03a1727 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] HTTP exception thrown: Volume tempest-invalid-183014121 could not be found. Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bca01dec-0b97-4004-b874-b5d4f03a1727 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 404 to user: Volume tempest-invalid-183014121 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bca01dec-0b97-4004-b874-b5d4f03a1727 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-183014121" status: 404 len: 98 microversion: 2.1 time: 0.044985 Nov 28 20:10:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 31/86] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Nov 28 20:10:55 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-183014121 => generated 98 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-08be2f78-cd5e-415b-b7e3-a46ee8314bff tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007242 Nov 28 20:10:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 30/87] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Nov 28 20:10:55 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-19e138a1-33ae-45fd-b95d-d1e3adcd7077 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003797 Nov 28 20:10:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 32/88] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Nov 28 20:10:55 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-28f23118-30f7-431c-a8f8-31ebf002e409 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Calling method '.version_select at 0x7f9e65373ac0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:10:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-28f23118-30f7-431c-a8f8-31ebf002e409 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] HTTP exception thrown: Volume 19dfd125-5437-4672-b537-36e026ca6b2c could not be found. Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-28f23118-30f7-431c-a8f8-31ebf002e409 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 404 to user: Volume 19dfd125-5437-4672-b537-36e026ca6b2c could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-28f23118-30f7-431c-a8f8-31ebf002e409 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/19dfd125-5437-4672-b537-36e026ca6b2c" status: 404 len: 109 microversion: 2.1 time: 0.054551 Nov 28 20:10:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 31/89] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:10:55 2023] DELETE /compute/v2.1/os-volumes/19dfd125-5437-4672-b537-36e026ca6b2c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2df08361-b6d6-4b3b-8e72-13a06aad7371 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Calling method '.version_select at 0x7f9e6535e050>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Getting quotas for project a23adb107ea2450687260c6260f14a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-2df08361-b6d6-4b3b-8e72-13a06aad7371 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] HTTP exception thrown: Volume 9607905f-51a6-489a-9c44-42235e9235d9 could not be found. Nov 28 20:10:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2df08361-b6d6-4b3b-8e72-13a06aad7371 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] Returning 404 to user: Volume 9607905f-51a6-489a-9c44-42235e9235d9 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:10:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2df08361-b6d6-4b3b-8e72-13a06aad7371 tempest-VolumesNegativeTest-1109906778 tempest-VolumesNegativeTest-1109906778-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9607905f-51a6-489a-9c44-42235e9235d9" status: 404 len: 109 microversion: 2.1 time: 0.033104 Nov 28 20:10:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 33/90] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:10:55 2023] GET /compute/v2.1/os-volumes/9607905f-51a6-489a-9c44-42235e9235d9 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Getting quotas for user 830afb679e5d46cca73c2ad15c3ae83b and project a23adb107ea2450687260c6260f14a9e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:10:55 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:10:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fd399509-cc71-47ca-8b92-b9e9ae47a56b tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.036086 Nov 28 20:10:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 27/91] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:10:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 2038 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d142654c-4b25-48cf-9bf1-7210129a4ccf tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:10:55 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d142654c-4b25-48cf-9bf1-7210129a4ccf tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:10:56 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-d142654c-4b25-48cf-9bf1-7210129a4ccf tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830afb679e5d46cca73c2ad15c3ae83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23adb107ea2450687260c6260f14a9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:10:56 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d142654c-4b25-48cf-9bf1-7210129a4ccf tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 200 len: 1205 microversion: 2.1 time: 0.209669 Nov 28 20:10:56 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:10:55 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 1205 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-397313947", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b"}], "security_groups": [{"name": "tempest-securitygroup--1965786445"}], "key_name": "tempest-keypair-344088806", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:00 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] validate_networks() for [('8cc12ce3-3e35-45e4-bbee-b5d66b5b468b', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-260ceb2c-af6d-4739-b383-7fb718dda684 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.561459 Nov 28 20:11:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 34/93] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:11:00 2023] POST /compute/v2.1/servers => generated 407 bytes in 2566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:11:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4230c7ad-c8bc-49b0-8514-abd66fd5900b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:03 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4230c7ad-c8bc-49b0-8514-abd66fd5900b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:03 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-4230c7ad-c8bc-49b0-8514-abd66fd5900b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4230c7ad-c8bc-49b0-8514-abd66fd5900b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1231 microversion: 2.1 time: 0.158929 Nov 28 20:11:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 28/94] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:03 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1231 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Creating event network-changed:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6556816f-6485-4576-b797-b4316c379b86 req-a486d7d0-ad61-4e12-9352-8b3fa5973c23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:05 user devstack@n-api.service[65585]: INFO nova.compute.rpcapi [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 20:11:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] Releasing lock "compute-rpcapi-router" {{(pid=65585) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 20:11:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-916563f6-77de-43a6-b9ac-899ef489bb0a None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196476 Nov 28 20:11:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 33/95] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2f988c37-657d-4d58-a08d-33c0162d8c33 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Action: 'create', calling method: .version_select at 0x7f9e652105e0>, body: {"keypair": {"name": "tempest-keypair-1745238648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB0OWWjuQd4dE5X2vm7yGb7xHx1upquomwhP+UabKwHK/1IkwgHLB9I3shvhWsJDuCJ6hKzLOm3A0CdQ0ZQQ0iJnqZ7fpxVqH2XiGfl3IXWC5JhikZD7HWo0MKm5CNeOQ=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:06 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-2f988c37-657d-4d58-a08d-33c0162d8c33 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for project 63ff2e349b40430a91730a22fd4a0487. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:06 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-2f988c37-657d-4d58-a08d-33c0162d8c33 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for user 0d747c1fd611452f8d0e6ee1b423cd2c and project 63ff2e349b40430a91730a22fd4a0487. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2f988c37-657d-4d58-a08d-33c0162d8c33 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.415313 Nov 28 20:11:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 35/96] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:11:06 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:08 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] Creating event network-changed:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:11:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-f2b21332-d5b7-4245-a8f8-f644d883fa36 req-e82d8b18-5de0-47c4-814a-1ed4da81a3f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056370 Nov 28 20:11:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 34/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-da8485fd-efa0-4ef4-a355-34aa89bc2363 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Action: 'create', calling method: .version_select at 0x7f9e653b2710>, body: {"keypair": {"name": "tempest-keypair-1011383959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYplXzwET4VCxpdXETVYQ20/108yZbkDYnBL+bsxPCGkwSbdM1+M+pvjeXnNj257ALlRgNAx6Chap7EsPxZI+6RHrK5yLGGnnoitoanfrSqV2YSww6dqblLCraEp0Kt8A=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-da8485fd-efa0-4ef4-a355-34aa89bc2363 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting quotas for project ed4b4be41b8c4b2d83a6ea935a176a7e. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-da8485fd-efa0-4ef4-a355-34aa89bc2363 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting quotas for user 56dee3003b03497db332c4719be3a045 and project ed4b4be41b8c4b2d83a6ea935a176a7e. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-da8485fd-efa0-4ef4-a355-34aa89bc2363 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.399293 Nov 28 20:11:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 29/98] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:11:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1008982212", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "3b3bc160-310f-422a-ab1d-d8090334b344"}], "security_groups": [{"name": "tempest-securitygroup--2110884943"}], "key_name": "tempest-keypair-1745238648", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:10 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] validate_networks() for [('3b3bc160-310f-422a-ab1d-d8090334b344', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for project 63ff2e349b40430a91730a22fd4a0487. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for user 0d747c1fd611452f8d0e6ee1b423cd2c and project 63ff2e349b40430a91730a22fd4a0487. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6e8b133a-60e8-4186-93a6-ffe687fec7ea tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.677028 Nov 28 20:11:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 36/99] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:11:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:11:11 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-115caa7b-799c-448f-a7e3-0ffc0edb5dc3 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:11 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-115caa7b-799c-448f-a7e3-0ffc0edb5dc3 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:11 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-115caa7b-799c-448f-a7e3-0ffc0edb5dc3 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:11 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-115caa7b-799c-448f-a7e3-0ffc0edb5dc3 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2" status: 200 len: 1234 microversion: 2.1 time: 0.157614 Nov 28 20:11:11 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 35/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:11 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2 => generated 1234 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-34592518", "imageRef": "0fe13e33-5c27-4eb1-8948-21098291272a", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "b64cd5b4-e6ba-413d-839a-465e577eebb4"}], "security_groups": [{"name": "tempest-securitygroup--936308589"}], "key_name": "tempest-keypair-1011383959", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:12 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] validate_networks() for [('b64cd5b4-e6ba-413d-839a-465e577eebb4', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting quotas for project ed4b4be41b8c4b2d83a6ea935a176a7e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Getting quotas for user 56dee3003b03497db332c4719be3a045 and project ed4b4be41b8c4b2d83a6ea935a176a7e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:13 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0fe13e33-5c27-4eb1-8948-21098291272a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-44d783c9-d6f4-45e0-b1bd-e617eaeaf560 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.832392 Nov 28 20:11:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 30/101] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:11:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:11:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-60f79a0d-3965-48ba-943b-06f43655ab07 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:13 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-60f79a0d-3965-48ba-943b-06f43655ab07 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:13 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-60f79a0d-3965-48ba-943b-06f43655ab07 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56dee3003b03497db332c4719be3a045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b4be41b8c4b2d83a6ea935a176a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-60f79a0d-3965-48ba-943b-06f43655ab07 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 200 len: 1236 microversion: 2.1 time: 0.208329 Nov 28 20:11:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 37/102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:13 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 1236 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-39f9672d-462d-4e12-884b-bbcf6878d6ff tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Action: 'create', calling method: .version_select at 0x7f9e69ccb880>, body: {"keypair": {"name": "tempest-keypair-1029990611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8qccgJ5L8n2VbmiZBJmXIcygNAyfnrvdVnhom0xN/KuMQ/b/tRiFbGabtnWwx5S33ukRea3zF/Z2zg9/+kWuwckhkbdQ/DMvabwXKP+5ly21Od6ocu0Es/N0ywrUvRAA=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:16 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:16 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-39f9672d-462d-4e12-884b-bbcf6878d6ff tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting quotas for project f356c386b1804c90ad27fd57bf6961ce. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:16 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-39f9672d-462d-4e12-884b-bbcf6878d6ff tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting quotas for user 8c5dbb5a65014af3b72843ad4fccd06f and project f356c386b1804c90ad27fd57bf6961ce. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-39f9672d-462d-4e12-884b-bbcf6878d6ff tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118908 Nov 28 20:11:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 36/103] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:11:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Creating event network-changed:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3825ac38-da16-4495-a277-f77b18504aca req-3a9ab95d-6d8d-4ad6-9d7a-8aa01e6a7a99 service nova] Acquired lock "compute-rpcapi-router" {{(pid=65586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:17 user devstack@n-api.service[65586]: INFO nova.compute.rpcapi [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 20:11:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] Releasing lock "compute-rpcapi-router" {{(pid=65586) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 20:11:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-00918ed5-5611-4fe1-a985-c7286178294e None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156097 Nov 28 20:11:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 31/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "name": "network-vif-plugged", "status": "completed", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Creating event network-vif-plugged:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=65587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed1ada1b-8de4-4d68-b440-ac99e505d9dd req-8a2309a5-9562-4dbd-8632-d7afa9a3b81d service nova] Acquired lock "compute-rpcapi-router" {{(pid=65587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:18 user devstack@n-api.service[65587]: INFO nova.compute.rpcapi [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Nov 28 20:11:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] Releasing lock "compute-rpcapi-router" {{(pid=65587) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}} Nov 28 20:11:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2b5d94f8-2564-4183-b568-2c7e08bf5a75 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.339516 Nov 28 20:11:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 38/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:11:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] Creating event network-changed:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:11:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-084e80aa-0b98-4e04-92c2-98031a26174d req-c88fdf86-a4d1-42ce-9427-f0fe5334fcf7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122208 Nov 28 20:11:20 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 37/106] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "name": "network-vif-plugged", "status": "completed", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:20 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1477944076", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "3c7d9d10-c298-4672-8ae8-c59553384435"}], "security_groups": [{"name": "tempest-securitygroup--772913788"}], "key_name": "tempest-keypair-1029990611", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] Creating event network-vif-plugged:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:11:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-7fdbb88f-ddd3-4442-9c0a-ff1dc2bcab18 req-3e207a93-519a-4d6f-a6aa-43996ab59c0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130606 Nov 28 20:11:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 32/107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:21 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] validate_networks() for [('3c7d9d10-c298-4672-8ae8-c59553384435', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting quotas for project f356c386b1804c90ad27fd57bf6961ce. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Getting quotas for user 8c5dbb5a65014af3b72843ad4fccd06f and project f356c386b1804c90ad27fd57bf6961ce. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:22 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bf6f188d-94c4-47c4-b06e-f9148caf6610 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.119700 Nov 28 20:11:22 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 39/108] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:11:20 2023] POST /compute/v2.1/servers => generated 403 bytes in 2123 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:11:22 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3f81f8b1-9a45-4e06-9b91-996523070d94 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:22 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3f81f8b1-9a45-4e06-9b91-996523070d94 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:23 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3f81f8b1-9a45-4e06-9b91-996523070d94 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5dbb5a65014af3b72843ad4fccd06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356c386b1804c90ad27fd57bf6961ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3f81f8b1-9a45-4e06-9b91-996523070d94 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756" status: 200 len: 1224 microversion: 2.1 time: 0.186858 Nov 28 20:11:23 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 38/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:22 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756 => generated 1224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=18 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "name": "network-vif-plugged", "status": "completed", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] Creating event network-vif-plugged:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:11:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-7c445e01-f5f8-4168-b43e-610a043e85a0 req-9a7fde26-2765-4349-bc4a-3008890ea74e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402788 Nov 28 20:11:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 33/110] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "name": "network-vif-plugged", "status": "completed", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] Creating event network-vif-plugged:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:11:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1b227e69-0da0-4575-8cea-76136db85ebb req-15dd6927-ce3a-44d4-bfbb-f01336247982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042119 Nov 28 20:11:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 40/111] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] Creating event network-changed:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:11:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7daa70d8-a617-44f4-8a7b-90654e8330c4 req-b9bc5a80-04e6-4ae2-a86f-4f22c5ecf5cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076032 Nov 28 20:11:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 39/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "name": "network-vif-plugged", "status": "completed", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] Creating event network-vif-plugged:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:11:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-42a3570d-a5ec-4cd3-84c7-b9b760da7861 req-233f880d-eb58-42ac-a052-97e71ff59697 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099639 Nov 28 20:11:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 34/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "name": "network-vif-plugged", "status": "completed", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}, {"server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "name": "network-vif-plugged", "status": "completed", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}, {"server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "name": "network-vif-plugged", "status": "completed", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Creating event network-vif-plugged:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:11:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Creating event network-vif-plugged:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:11:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] Creating event network-vif-plugged:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:11:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-4ac897d1-15e8-4020-9add-f1e73e024121 req-161d3390-15fb-4c3c-a55b-2b5ff210d29d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.076900 Nov 28 20:11:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 41/114] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:29 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "name": "network-vif-plugged", "status": "completed", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] Creating event network-vif-plugged:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:11:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ea5b9b52-901c-4777-80f8-ee7f774bee7e req-e3b38e4e-acdc-4681-9065-32940d5e2555 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080950 Nov 28 20:11:31 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 40/115] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:33 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9379843d-8509-46b9-8010-f60216481b11 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Action: 'create', calling method: .version_select at 0x7f9e64a60c10>, body: {"keypair": {"name": "tempest-keypair-448215708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCG6Xb2b289i94kzq7mRKEPfFFFiPwMG1Ax8zd+3NfUydS8o64GAfxeGZLhx6dUt1q6V5b8gVKa4LMu8Qe11Hu8MDVA+VA1GLE3Pw67neyU87X6frDyM9AaWBV48vqdSfw=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:33 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-9379843d-8509-46b9-8010-f60216481b11 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Getting quotas for project 16b1448d67fd4c94a0d1374ed792b428. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:33 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-9379843d-8509-46b9-8010-f60216481b11 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Getting quotas for user ac5d0e5911d94f0c96e5065db9729740 and project 16b1448d67fd4c94a0d1374ed792b428. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9379843d-8509-46b9-8010-f60216481b11 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.760554 Nov 28 20:11:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 35/116] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:11:32 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=28 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "name": "network-vif-plugged", "status": "completed", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] Creating event network-vif-plugged:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:11:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-42f4901d-d008-4921-b014-1acc09de72bd req-3790dff0-66cf-4648-a4d4-6a7bd6f99752 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.539782 Nov 28 20:11:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 42/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:35 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAssistedSnapshotsTest-server-42165751", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "af31f11d-7ec4-4cc7-b346-0acf29157d15"}], "security_groups": [{"name": "tempest-securitygroup--1156444283"}], "key_name": "tempest-keypair-448215708", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:36 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] validate_networks() for [('af31f11d-7ec4-4cc7-b346-0acf29157d15', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Getting quotas for project 16b1448d67fd4c94a0d1374ed792b428. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Getting quotas for user ac5d0e5911d94f0c96e5065db9729740 and project 16b1448d67fd4c94a0d1374ed792b428. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:37 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-237dbcb7-07f3-44ac-861f-50633c9f7329 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.344836 Nov 28 20:11:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 41/118] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:11:35 2023] POST /compute/v2.1/servers => generated 404 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:11:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-097f7585-15c2-42ec-a5a1-0e216464798e tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-097f7585-15c2-42ec-a5a1-0e216464798e tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:37 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-097f7585-15c2-42ec-a5a1-0e216464798e tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5d0e5911d94f0c96e5065db9729740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b1448d67fd4c94a0d1374ed792b428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-097f7585-15c2-42ec-a5a1-0e216464798e tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710" status: 200 len: 1235 microversion: 2.1 time: 0.114517 Nov 28 20:11:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 36/119] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:37 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710 => generated 1235 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsV293TestJSON-server-875799677", "imageRef": "", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "8b0c6ae3-604b-433f-920b-f28cc17a9cf0"}], "security_groups": [{"name": "tempest-securitygroup--1054419125"}], "key_name": "tempest-keypair-1302784070", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "fa0184f2-4a56-4d02-95cb-f5b41506ed72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, ": true}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:40 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] validate_networks() for [('8b0c6ae3-604b-433f-920b-f28cc17a9cf0', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:11:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:11:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] Creating event network-changed:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:11:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-1d9e2d5c-b77a-4211-86d6-a1bec47ef490 req-83bef32e-7b90-4113-8db9-07b21fa05ffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058962 Nov 28 20:11:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 42/120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for project fed1996731e94c8eb5c16e6327b32f39. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for user d313e776858a411ea463adecd1f36819 and project fed1996731e94c8eb5c16e6327b32f39. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:11:41 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fa0184f2-4a56-4d02-95cb-f5b41506ed72',volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:11:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9686709d-d171-4d77-ab1b-a94e6f949b42 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.93 time: 1.353241 Nov 28 20:11:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 43/121] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:11:40 2023] POST /compute/v2.1/servers => generated 407 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4a23e269-1110-4c54-8b7a-422fb930a923 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1332 microversion: 2.93 time: 0.087060 Nov 28 20:11:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 37/122] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:11:41 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:11:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "name": "network-vif-plugged", "status": "completed", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] Creating event network-vif-plugged:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:11:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-43ee1ac9-202a-4fc4-a3f3-b5e1ee622700 req-e5425dff-c575-4f1b-af4e-ac58a44357b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125007 Nov 28 20:11:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 43/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] Creating event network-changed:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:11:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-fdad6e4d-d916-44ed-bd17-bda7ded42516 req-d407cfdd-fb01-4eca-ba8c-4393149f13a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054265 Nov 28 20:11:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 44/124] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "name": "network-vif-plugged", "status": "completed", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] Creating event network-vif-plugged:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:11:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-02bb7f55-1879-45c2-8b9d-bb7a14c413c2 req-ed85a0ee-7092-4d05-adf9-898dbfa266ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146387 Nov 28 20:11:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 44/125] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:11:47 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830afb679e5d46cca73c2ad15c3ae83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23adb107ea2450687260c6260f14a9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9b22a879-a336-4662-9ac4-ff2f004b71f3 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 200 len: 1484 microversion: 2.1 time: 0.839226 Nov 28 20:11:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 38/126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:46 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 1484 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=14 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:53 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:11:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a4308619-0149-4204-b852-ce45e306d6a6 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1539 microversion: 2.1 time: 0.490852 Nov 28 20:11:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 45/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:11:53 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1539 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=5 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=14 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-plugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:11:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:11:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] Creating event network-vif-plugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:11:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-18c0d84a-f037-45fd-a58d-8bc48ede33e5 req-5da64f9c-8ada-4e98-9828-9b6cfe430c72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085531 Nov 28 20:11:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 45/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:11:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-plugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] Creating event network-vif-plugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:12:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-67815bb1-03ac-4569-be91-1015933f564d req-f6504b42-e95c-4c98-8c59-a2a8085e99e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Nov 28 20:12:01 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 39/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=27 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:02 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9a88cf85-b95c-4a4a-9379-0094737fbd96 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2" status: 200 len: 1544 microversion: 2.1 time: 0.292427 Nov 28 20:12:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 46/130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:01 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2 => generated 1544 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-33b96f81-a2b7-4a86-8fc0-59ae46f13ddd tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Action: 'create', calling method: .version_select at 0x7f9e64a636d0>, body: {"keypair": {"name": "tempest-keypair-642922695", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN07ppbXoYjx3Ha3M77Wxdf0yUlEFcVbCWiceOXa08khAWgP0JxHJaOafs4Bxj2gMATYPLg5DeGYs6NFGbylRFQeFwJ8GzxzC1Oh2l6N89h4kvK8jh+MTq/BBFSpWfP0Iw=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:03 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-33b96f81-a2b7-4a86-8fc0-59ae46f13ddd tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting quotas for project 8d1a4972442f432da170242f18d528e7. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:03 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-33b96f81-a2b7-4a86-8fc0-59ae46f13ddd tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting quotas for user be9e9698937848dbb2b073607f73af64 and project 8d1a4972442f432da170242f18d528e7. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-33b96f81-a2b7-4a86-8fc0-59ae46f13ddd tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.078877 Nov 28 20:12:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 40/131] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:12:03 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:12:04 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56dee3003b03497db332c4719be3a045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b4be41b8c4b2d83a6ea935a176a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-00a60f02-4335-47d9-8f8e-adbb1c986471 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 200 len: 1546 microversion: 2.1 time: 0.429831 Nov 28 20:12:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 46/132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:03 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 1546 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:12:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-759809128", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "8ac9ca6d-d1f1-4241-ae50-c00452fb1fab"}, {"port": "5bdfc240-06a9-47c2-b496-bda3e4931c80", "tag": "port-1"}, {"port": "1732200a-bf2a-477a-b72e-7191f2ccfb4e", "tag": "port-2"}, {"uuid": "0daf9f89-afa5-4c78-9079-8b195d3b64d3", "tag": "net-1"}, {"uuid": "0daf9f89-afa5-4c78-9079-8b195d3b64d3"}, {"uuid": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "93522955-fc00-44c2-b0d9-b7b4bb2f69a2", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "268567d9-8c0c-46d9-8bc0-70157c860620", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "69f15c27-93a6-49d9-8e7c-b001e771f4f3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b91bfea3-75ee-40af-b479-01a81b104cc5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1871470907"}], "key_name": "tempest-keypair-642922695", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:05 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] validate_networks() for [('8ac9ca6d-d1f1-4241-ae50-c00452fb1fab', None, None, None, None, None), (None, None, '5bdfc240-06a9-47c2-b496-bda3e4931c80', None, None, None), (None, None, '1732200a-bf2a-477a-b72e-7191f2ccfb4e', None, None, None), ('0daf9f89-afa5-4c78-9079-8b195d3b64d3', None, None, None, None, None), ('0daf9f89-afa5-4c78-9079-8b195d3b64d3', None, None, None, None, None), ('93522955-fc00-44c2-b0d9-b7b4bb2f69a2', '10.2.2.100', None, None, None, None), ('93522955-fc00-44c2-b0d9-b7b4bb2f69a2', '10.2.2.200', None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting quotas for project 8d1a4972442f432da170242f18d528e7. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Getting quotas for user be9e9698937848dbb2b073607f73af64 and project 8d1a4972442f432da170242f18d528e7. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:12:08 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='268567d9-8c0c-46d9-8bc0-70157c860620',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='69f15c27-93a6-49d9-8e7c-b001e771f4f3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b91bfea3-75ee-40af-b479-01a81b104cc5',volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:12:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d426ed7e-3ef9-4649-b8f1-6956466f843e tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 3.527975 Nov 28 20:12:09 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 47/133] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 20:12:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 3529 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:12:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-57164ad2-41b3-42c4-97ec-aca3f5af2373 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 200 len: 1276 microversion: 2.32 time: 0.063761 Nov 28 20:12:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 41/134] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:12:09 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 1276 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:13 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5dbb5a65014af3b72843ad4fccd06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356c386b1804c90ad27fd57bf6961ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:13 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-5441d005-6ba9-4365-a75c-1b19777ecf5e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756" status: 200 len: 1524 microversion: 2.1 time: 0.389935 Nov 28 20:12:13 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 47/135] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:13 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756 => generated 1524 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] Creating event network-changed:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-da0e82e1-da17-4f3f-9a51-e7ac7c80c3b5 req-0ae776b2-0c61-4661-a591-eb41e0e7bff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045997 Nov 28 20:12:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 48/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "5bdfc240-06a9-47c2-b496-bda3e4931c80"}, {"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "1732200a-bf2a-477a-b72e-7191f2ccfb4e"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Creating event network-changed:5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] Creating event network-changed:1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-badb23df-7a9f-4076-839e-3be4df0d11d1 req-3788e925-4c43-402b-8857-a90d1506041d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034373 Nov 28 20:12:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 42/137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}, {"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Creating event network-changed:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] Creating event network-changed:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e6e0c219-1a11-4abf-a3a5-1b611d79583c req-9b788126-64ba-4cd3-9365-0f7d0aaceccf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035352 Nov 28 20:12:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 48/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Creating event network-changed:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] Creating event network-changed:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-c9c3e41b-5eea-462f-9711-ff89d26ae5b7 req-8626d3a4-b65a-4fdb-a5f1-6466fddf49e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034895 Nov 28 20:12:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 49/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:21 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:27 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5d0e5911d94f0c96e5065db9729740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b1448d67fd4c94a0d1374ed792b428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9f0658b2-c7e7-4d64-b5ac-f224270a45f9 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710" status: 200 len: 1548 microversion: 2.1 time: 0.245802 Nov 28 20:12:27 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 43/140] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:27 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710 => generated 1548 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2082525117", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:28 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] validate_networks() for None {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Getting quotas for project 4b6bbaa4bb5b47668fa7beddd9dbcb69. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Getting quotas for user 637fd3a4988b4f5cbb9507b3e850effa and project 4b6bbaa4bb5b47668fa7beddd9dbcb69. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:12:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:12:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2250ee09-f901-4141-9454-d6ecda9e5022 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.642969 Nov 28 20:12:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 49/141] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:12:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:12:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4ec1190b-dd45-4cdb-ae12-13941109e7c6 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:29 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4ec1190b-dd45-4cdb-ae12-13941109e7c6 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-4ec1190b-dd45-4cdb-ae12-13941109e7c6 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '637fd3a4988b4f5cbb9507b3e850effa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bbaa4bb5b47668fa7beddd9dbcb69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4ec1190b-dd45-4cdb-ae12-13941109e7c6 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317" status: 200 len: 1207 microversion: 2.1 time: 0.084083 Nov 28 20:12:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 50/142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:29 2023] GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317 => generated 1207 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:32 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:32 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:32 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6710cccc-c319-4d96-9401-d367e8431e0d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1720 microversion: 2.93 time: 0.439475 Nov 28 20:12:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 44/143] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:12:31 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1720 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:12:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e902b4e2-d53e-459f-a10e-bcbba4fc2317", "tag": "3eabc9ee-0a3a-48ec-8956-6036d0217183"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] Creating event network-changed:3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 on user Nov 28 20:12:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e6fbf2fc-dd96-487d-b4cf-0d96f125726d req-becee24d-cd77-4846-b38d-0fb4364c03cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042207 Nov 28 20:12:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 50/144] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902b4e2-d53e-459f-a10e-bcbba4fc2317", "name": "network-vif-plugged", "status": "completed", "tag": "3eabc9ee-0a3a-48ec-8956-6036d0217183"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=11 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] Creating event network-vif-plugged:3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 on user Nov 28 20:12:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-2591c7c0-d0de-497a-bad9-e3ae2c57a181 req-cd9c4875-3041-436e-89ed-b8117ef0cd18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040667 Nov 28 20:12:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 51/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902b4e2-d53e-459f-a10e-bcbba4fc2317", "name": "network-vif-plugged", "status": "completed", "tag": "3eabc9ee-0a3a-48ec-8956-6036d0217183"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] Creating event network-vif-plugged:3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 on user Nov 28 20:12:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-98fea834-761c-4ed5-806e-d95cc48af511 req-5a7266e4-7adb-4633-9d32-b6b334e65088 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032972 Nov 28 20:12:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 45/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=20 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1829120743", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "00de1a40-1743-4c1d-a032-0ae863c7e009"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] Creating event network-vif-plugged:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-f25413f1-b23b-4596-b406-5e3b1c68bf19 req-b8d1a192-d3a0-495e-ac13-487c0ecb191e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055645 Nov 28 20:12:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 51/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] validate_networks() for [('00de1a40-1743-4c1d-a032-0ae863c7e009', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting quotas for project bed5b9f19e584ca5bd8bf2d75b5ee765. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting quotas for user 854e01c9d8d644299bbf6b9a18e00fcd and project bed5b9f19e584ca5bd8bf2d75b5ee765. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:12:43 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:12:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7741b673-8741-4bca-946a-187a82655d6d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.817300 Nov 28 20:12:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 52/148] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:12:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:12:43 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-176b466a-0d87-4817-9250-a169d8a6528d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:43 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-176b466a-0d87-4817-9250-a169d8a6528d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:43 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-176b466a-0d87-4817-9250-a169d8a6528d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-176b466a-0d87-4817-9250-a169d8a6528d tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" status: 200 len: 1206 microversion: 2.1 time: 0.093551 Nov 28 20:12:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 46/149] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:43 2023] GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 => generated 1206 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] Creating event network-vif-plugged:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-11f74d65-5d6a-468d-9e80-4a10321f7bd2 req-52c5c076-c90b-4099-8596-d9ce07643434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053942 Nov 28 20:12:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 52/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] Creating event network-vif-plugged:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1e5433fb-fca0-42c5-8b9c-ffd52e6f0240 req-15bed0a9-b7c0-4de8-afb6-e90dc5ad9286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032521 Nov 28 20:12:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 53/151] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "5bdfc240-06a9-47c2-b496-bda3e4931c80"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] Creating event network-vif-plugged:5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f336bcc6-28d1-4a28-8df2-208443310315 req-f51083da-f13e-41c7-9b00-97236c4ef808 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029102 Nov 28 20:12:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 47/152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Creating event network-vif-plugged:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Creating event network-vif-plugged:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Creating event network-vif-plugged:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Creating event network-vif-plugged:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] Creating event network-vif-plugged:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-acb699c2-21aa-47b7-af0c-c05a7b55cc9f req-5cc6e2d8-6401-4e31-8cdb-ca19c61e96db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.044342 Nov 28 20:12:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 53/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "5bdfc240-06a9-47c2-b496-bda3e4931c80"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "1732200a-bf2a-477a-b72e-7191f2ccfb4e"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "1732200a-bf2a-477a-b72e-7191f2ccfb4e"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Creating event network-vif-plugged:5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Creating event network-vif-plugged:1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Creating event network-vif-plugged:1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Creating event network-vif-plugged:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] Creating event network-vif-plugged:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:12:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-3bebfcc0-c3f2-4b7a-9360-0b5b77c99449 req-339ecf0c-68e0-4231-8883-79d9523591a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.051104 Nov 28 20:12:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 54/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] Creating event network-changed:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:12:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f109e702-fad5-4d9d-b115-2cd9464a47ba req-01b9babd-98c1-40ef-9549-7b5435cf4236 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029525 Nov 28 20:12:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 48/155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5bf0ecc-30b8-40c5-b56b-1a41db2efe35"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:50 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "name": "network-vif-plugged", "status": "completed", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}, {"server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "name": "network-vif-plugged", "status": "completed", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:50 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Creating event network-vif-plugged:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:12:50 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] Creating event network-vif-plugged:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:12:50 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ca50b06a-b2ad-4525-92e8-279cff84614d req-1882c73b-5e99-494a-9e13-ad40183a06c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.220265 Nov 28 20:12:50 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 55/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7cd3b717-ab2d-43be-b3fd-73d7503e0ebc tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "POST /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962461 Nov 28 20:12:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 54/157] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:12:49 2023] POST /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8b88563c-43fb-4120-8190-4f2fc08df7bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.271319 Nov 28 20:12:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 49/158] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:12:53 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151/os-interface => generated 282 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bcfd4f7f-7459-4062-9dc4-cf4b3099c328 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'create', calling method: .version_select at 0x7f9e654eca60>, body: {"keypair": {"name": "tempest-TestStampPattern-550063434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOKHSIcqSS6r5Xbk8DWkPtgQAYtxPI66k2MpIys7luJ+eXKJCwl3YX7s+WE2XtlqbyhCHYbp1Jbg6h1ZtUXzTkBXgQiD1zygrVkmZ1u0tehRUXvexgqD4sXlJ9Q5zsLuRw=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-bcfd4f7f-7459-4062-9dc4-cf4b3099c328 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for project 742419219fb94804bef60efd10716a41. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:54 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-bcfd4f7f-7459-4062-9dc4-cf4b3099c328 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for user 29664fb367db470abbd15cfbf39dd38a and project 742419219fb94804bef60efd10716a41. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bcfd4f7f-7459-4062-9dc4-cf4b3099c328 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.355048 Nov 28 20:12:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 56/159] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:12:54 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] Creating event network-changed:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:12:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5b86778b-efd2-4770-a4aa-1fe8c547d37a req-1da056a5-fee0-4916-b00f-3440497aa1a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048180 Nov 28 20:12:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 55/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:12:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:56 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-078ea5ad-a14d-463f-8448-6c029408cd8c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.335522 Nov 28 20:12:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 50/161] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:55 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:56 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-36a45f04-50c4-44ff-9849-51148a954517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.272120 Nov 28 20:12:56 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 57/162] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:56 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:56 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:56 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4ee180e6-ac20-4f39-8e7e-f07a67793ae5 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.227317 Nov 28 20:12:56 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 56/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:56 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-693276343", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "key_name": "tempest-TestStampPattern-550063434", "security_groups": [{"name": "tempest-secgroup-smoke-2066102401"}], "networks": [{"uuid": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] validate_networks() for [('3f7305f6-e668-4fc6-82bd-f6f519c2bd85', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for project 742419219fb94804bef60efd10716a41. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for user 29664fb367db470abbd15cfbf39dd38a and project 742419219fb94804bef60efd10716a41. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:12:57 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:12:58 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:12:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0707f6f9-3bd1-41b4-9a00-e15200169458 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.819145 Nov 28 20:12:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 51/164] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:12:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:12:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f698509e-5eac-4a05-986b-586c9bbba1c5 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f698509e-5eac-4a05-986b-586c9bbba1c5 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:58 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-f698509e-5eac-4a05-986b-586c9bbba1c5 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f698509e-5eac-4a05-986b-586c9bbba1c5 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 200 len: 1233 microversion: 2.1 time: 0.189492 Nov 28 20:12:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 58/165] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:12:58 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 1233 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:59 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:12:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8b863b0d-5d79-4d1b-9013-cb4191ae460c tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 200 len: 2820 microversion: 2.32 time: 0.526283 Nov 28 20:12:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 57/166] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:12:59 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 2820 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:13:01 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] Creating event network-changed:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:13:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-ca951a6a-6e23-426d-a2af-0238deb12a3e req-b863f4d0-f3fb-4c0f-b877-b9f266227651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044855 Nov 28 20:13:01 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 52/167] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-df285879-e32c-4944-82f8-75067889ae0a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.611883 Nov 28 20:13:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 59/168] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:13:02 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-interface => generated 282 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:03 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:13:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fec668e2-413b-435f-b2ec-3a663beb2ca4 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 204 len: 0 microversion: 2.1 time: 0.198321 Nov 28 20:13:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 58/169] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:13:02 2023] DELETE /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:03 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '830afb679e5d46cca73c2ad15c3ae83b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a23adb107ea2450687260c6260f14a9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-db2b4eb6-1d9f-4fea-ac75-f20786541fa8 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 200 len: 1536 microversion: 2.1 time: 0.432611 Nov 28 20:13:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 53/170] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:03 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 1536 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:13:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "name": "network-vif-unplugged", "status": "completed", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] Creating event network-vif-unplugged:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:13:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b919a0c4-ee37-4223-83b0-529de1be336b req-fc438dc3-d304-4588-8295-279b57a0684a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057850 Nov 28 20:13:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 60/171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-plugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] Creating event network-vif-plugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:13:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-bf292b15-dd88-4800-be4c-95d3c86e7269 req-61046673-2464-4500-8d69-ec32db3715b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043793 Nov 28 20:13:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 59/172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] Creating event network-changed:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:13:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-2ff0bd8e-532d-47b7-ab7a-ef78c9bde525 req-bc78cb9b-6ce6-4c59-bb32-fff4ee64cdf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035570 Nov 28 20:13:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 54/173] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3e0cb8df-4c75-46ea-a561-e891e2223c20 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.254444 Nov 28 20:13:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 61/174] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:13:04 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-interface => generated 283 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "name": "network-vif-plugged", "status": "completed", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] Creating event network-vif-plugged:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:13:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3d07fe83-82fd-4c4e-9111-ab931fc42445 req-5700f6b6-29f3-48e3-a97e-b499a4d22b51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044398 Nov 28 20:13:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-plugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] Creating event network-vif-plugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:13:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f7756d5e-b09c-4715-aae0-d76e17c51c92 req-1f1f3ec2-acdc-405f-879c-c5f405af4b33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036633 Nov 28 20:13:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 55/176] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] Creating event network-changed:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:13:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-f3742df5-4be5-414a-be2a-6b16aace03ee req-0cc0ff7b-bf94-4cca-9ba6-d7209ceef4ea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043079 Nov 28 20:13:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 62/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf35ee65-861a-4cfd-9e94-fc02d8f0f180"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42d7a4d5-4d2a-4803-b253-b656aec16f69", "name": "network-vif-deleted", "tag": "a382b348-9cff-4cf4-9651-4fd406284eca"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] Creating event network-vif-deleted:a382b348-9cff-4cf4-9651-4fd406284eca for instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 on user Nov 28 20:13:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-66ec1e8e-241f-4e78-a37b-83516c64878f req-e4bfff78-7cee-4794-b0fc-e750a2703d68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042677 Nov 28 20:13:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 56/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-af238183-9ac3-4760-8a14-57c4efaa4980 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442461 Nov 28 20:13:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 61/179] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:13:07 2023] POST /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments => generated 194 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a30bcfd-1fe1-40b4-b548-de392d8adc21"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c10cec2d-0522-4865-b843-e7275732d46b tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "POST /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502783 Nov 28 20:13:09 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 63/180] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:13:09 2023] POST /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c83241e3-b4eb-4964-88b5-1ae6f869a9d9 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.173074 Nov 28 20:13:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 57/181] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:13:13 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-interface => generated 283 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] Creating event network-changed:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:13:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ec3f7674-a4a1-4bf0-8fc2-311f3cbc6549 req-9ada2a2f-5f58-4fa9-8869-f300ea45ee45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058445 Nov 28 20:13:15 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1537a8f-618a-4dc3-aa95-77f77a33e2fb"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8a5e73a7-e5f8-4d42-8b53-cced074438ad tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356490 Nov 28 20:13:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 64/183] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:13:15 2023] POST /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:19 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '637fd3a4988b4f5cbb9507b3e850effa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bbaa4bb5b47668fa7beddd9dbcb69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f896a339-1a8b-4d1a-a093-44b2a8994810 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317" status: 200 len: 1453 microversion: 2.1 time: 0.222549 Nov 28 20:13:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 58/184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:19 2023] GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317 => generated 1453 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "38d594ec-446e-4a19-a5ae-9371a985e1b0"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6b18771d-f1e3-40c0-a539-c219a9202ce6 tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/d1537a8f-618a-4dc3-aa95-77f77a33e2fb" status: 202 len: 0 microversion: 2.1 time: 0.423313 Nov 28 20:13:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 63/185] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 20:13:25 2023] PUT /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/d1537a8f-618a-4dc3-aa95-77f77a33e2fb => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a4bda87f-fe6e-42ce-a864-ce83f4092d93 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.184626 Nov 28 20:13:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 65/186] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:13:27 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0a754997-110e-447e-94e3-96d72bb1de5d"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:27 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:27 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=57 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] HTTP exception thrown: Volume 0a754997-110e-447e-94e3-96d72bb1de5d could not be found. Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Returning 400 to user: Volume 0a754997-110e-447e-94e3-96d72bb1de5d could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:13:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-dbd45dfd-4cda-48f6-a3de-399150b36165 tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments/cf35ee65-861a-4cfd-9e94-fc02d8f0f180" status: 400 len: 107 microversion: 2.1 time: 0.307472 Nov 28 20:13:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 59/187] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 20:13:27 2023] PUT /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments/cf35ee65-861a-4cfd-9e94-fc02d8f0f180 => generated 107 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lazy-loading 'services' on Instance uuid fe726611-331a-495f-a6bd-ced2d1a305b2 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9a0d3138-02af-48b2-99d2-2d8cb6dae17b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments/cf35ee65-861a-4cfd-9e94-fc02d8f0f180" status: 202 len: 0 microversion: 2.1 time: 0.276072 Nov 28 20:13:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 64/188] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:13:28 2023] DELETE /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments/cf35ee65-861a-4cfd-9e94-fc02d8f0f180 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] Creating event network-changed:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-cee08032-f517-4e2c-929f-e9aeccb3f10c req-0220a04e-e0b8-4f3d-a01c-1ba293b6e70f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040624 Nov 28 20:13:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 66/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-60ce3e46-b0f8-4a88-a640-9f6af7cd61bf tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053231 Nov 28 20:13:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 60/190] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:28 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a88cdcb-c692-441b-90ca-dd777b566a4d"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-86610c1f-f1b4-44de-b9c5-96b1e6efd64f tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] 10.0.0.210 "POST /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356292 Nov 28 20:13:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 65/191] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:13:28 2023] POST /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-493920a9-7d29-453b-a53b-a687ead8efcf tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051161 Nov 28 20:13:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 67/192] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:28 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:29 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lazy-loading 'services' on Instance uuid 958252cc-398e-4cc6-bd8d-937c99ef2b70 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:13:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6a05d075-1da5-45c3-9b2f-ca6290549741 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments/4a30bcfd-1fe1-40b4-b548-de392d8adc21" status: 202 len: 0 microversion: 2.1 time: 0.249869 Nov 28 20:13:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 61/193] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:13:29 2023] DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments/4a30bcfd-1fe1-40b4-b548-de392d8adc21 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1652c56e-92e2-4bdb-b432-f66a943e2b7a tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a/os-interface" status: 200 len: 295 microversion: 2.93 time: 0.392931 Nov 28 20:13:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 66/194] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:13:32 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a/os-interface => generated 295 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:33 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] Creating event network-changed:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:13:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-965c233d-c1fe-4343-bf7e-9a39c38a21d6 req-08fd5777-930a-4fdc-a69b-52e8a517ece8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051698 Nov 28 20:13:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 62/195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:33 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a52c86db-a8b2-4686-8b9a-0e0112a86bab tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1720 microversion: 2.93 time: 0.358555 Nov 28 20:13:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 68/196] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:13:33 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1720 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsV293TestJSON-server-1642565132", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-611d7135-138f-460d-8dd1-3933fe8d774a tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" status: 200 len: 1484 microversion: 2.1 time: 0.203489 Nov 28 20:13:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 67/197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:34 2023] GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 => generated 1484 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for project fed1996731e94c8eb5c16e6327b32f39. Resources: dict_keys(['metadata_items']) {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Getting quotas for user d313e776858a411ea463adecd1f36819 and project fed1996731e94c8eb5c16e6327b32f39. Resources: dict_keys(['metadata_items']) {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e46f23f4-c2f2-41ce-bc28-094f453c3436 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "POST /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a/action" status: 202 len: 2045 microversion: 2.93 time: 0.744566 Nov 28 20:13:34 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 63/198] 10.0.0.210 () {66 vars in 1397 bytes} [Tue Nov 28 20:13:34 2023] POST /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a/action => generated 2045 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 28 20:13:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-49f7c4ed-f40f-424f-bec1-8f78ac6028bc tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-49f7c4ed-f40f-424f-bec1-8f78ac6028bc tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/flavors/1" status: 200 len: 423 microversion: 2.93 time: 0.013638 Nov 28 20:13:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 69/199] 10.0.0.210 () {64 vars in 1249 bytes} [Tue Nov 28 20:13:34 2023] GET /compute/v2.1/flavors/1 => generated 423 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-unplugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] Creating event network-vif-unplugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:13:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cc6469e8-bc2e-4c9f-b5ce-4631970f84e5 req-a0960327-1dd7-46ad-8292-54bffde09ca6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036440 Nov 28 20:13:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 64/200] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:35 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-27ad26f9-2845-4ae7-9f49-839c17a38246 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1868 microversion: 2.93 time: 0.294741 Nov 28 20:13:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 68/201] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:13:35 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1868 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:13:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-plugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] Creating event network-vif-plugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:13:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-fe5aa81a-1775-4348-b703-58e4707f97da req-184a7dc7-cb31-4a65-8edd-981ff9cea704 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056777 Nov 28 20:13:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 70/202] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "9a88cdcb-c692-441b-90ca-dd777b566a4d", "create_info": {"snapshot_id": "f7930ef6-2a96-40ea-89a7-57185f53c29b", "type": "qcow2", "new_file": "new_file"}}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88105936-ce3a-426e-b16b-d7ab0f9004ae(cell1) {{(pid=65586) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8c4ad60b-8675-440e-b121-9fc918ec6432 tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] 10.0.0.210 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.287512 Nov 28 20:13:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 65/203] 10.0.0.210 () {64 vars in 1287 bytes} [Tue Nov 28 20:13:39 2023] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88105936-ce3a-426e-b16b-d7ab0f9004ae(cell1) {{(pid=65585) load_cells /opt/stack/nova/nova/compute/api.py:320}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ad0647ed-276f-48c4-8d90-29735125119e tempest-VolumesAssistedSnapshotsTest-19991253 tempest-VolumesAssistedSnapshotsTest-19991253-project] 10.0.0.210 "DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%229a88cdcb-c692-441b-90ca-dd777b566a4d%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.100863 Nov 28 20:13:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1442 bytes} [Tue Nov 28 20:13:40 2023] DELETE /compute/v2.1/os-assisted-volume-snapshots/None?delete_info=%7B%22volume_id%22%3A+%229a88cdcb-c692-441b-90ca-dd777b566a4d%22%7D => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lazy-loading 'services' on Instance uuid 415392e8-bf6c-433e-a4f5-be3d99419710 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:13:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6acd5ee4-e1d5-4620-9e52-4763de8df610 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] 10.0.0.210 "DELETE /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments/9a88cdcb-c692-441b-90ca-dd777b566a4d" status: 202 len: 0 microversion: 2.1 time: 0.259633 Nov 28 20:13:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 71/205] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:13:40 2023] DELETE /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments/9a88cdcb-c692-441b-90ca-dd777b566a4d => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f841b0ec-e3ee-4db1-983c-2bb6302a38d3 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049421 Nov 28 20:13:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 66/206] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:40 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b678a1f7-136a-44be-b9d7-dfb7df58e536 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069290 Nov 28 20:13:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:42 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d21290d9-d98d-4acb-824e-6bae1af86e7b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Nov 28 20:13:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 72/208] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:42 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "d1537a8f-618a-4dc3-aa95-77f77a33e2fb"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fdf498d4-c868-4a9c-af40-5dba598d73ce tempest-TestVolumeSwap-488772853 tempest-TestVolumeSwap-488772853-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/38d594ec-446e-4a19-a5ae-9371a985e1b0" status: 202 len: 0 microversion: 2.1 time: 0.327672 Nov 28 20:13:43 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 67/209] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 20:13:42 2023] PUT /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/38d594ec-446e-4a19-a5ae-9371a985e1b0 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:48 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-dbd8c128-8379-4edd-bc31-c74f904e64a1 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 200 len: 1534 microversion: 2.1 time: 0.374679 Nov 28 20:13:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 71/210] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:48 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 1534 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c95d4eda-91ee-46c5-9d9d-c1aaf32e9017 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046844 Nov 28 20:13:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 73/211] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:51 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3fd223f0-f397-40b0-875d-ef8d94b50e46 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047193 Nov 28 20:13:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 68/212] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:52 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:13:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-44184a90-a7e8-4455-aa6e-22fb0eb75d6e tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 204 len: 0 microversion: 2.1 time: 0.140436 Nov 28 20:13:52 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 72/213] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:13:52 2023] DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56dee3003b03497db332c4719be3a045', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed4b4be41b8c4b2d83a6ea935a176a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:13:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cda834cf-4a82-4344-9e34-09cbfeb17cd2 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 200 len: 1671 microversion: 2.1 time: 0.229478 Nov 28 20:13:52 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 74/214] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:52 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 1671 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "name": "network-vif-unplugged", "status": "completed", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] Creating event network-vif-unplugged:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:13:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-c1f7020d-5143-4114-a11e-2f89df9518f8 req-4de70f52-a599-4683-a85f-a0e065c8ce33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.026973 Nov 28 20:13:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 69/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] HTTP exception thrown: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. Nov 28 20:13:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Returning 404 to user: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:13:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-eac9c7be-51c0-4293-ace5-938ff48e11b1 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 404 len: 111 microversion: 2.1 time: 0.035148 Nov 28 20:13:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:53 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] HTTP exception thrown: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. Nov 28 20:13:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Returning 404 to user: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:13:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e2d1ca99-878e-4b67-92c1-d684bdd1773c tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036015 Nov 28 20:13:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 75/217] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:13:53 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:13:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "name": "network-vif-deleted", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] Creating event network-vif-deleted:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:13:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-b643be7f-b573-43d6-8d03-07d5b57753c0 req-c8f97c81-ad2c-4d21-9190-244f989427af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062538 Nov 28 20:13:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 70/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "958252cc-398e-4cc6-bd8d-937c99ef2b70", "name": "network-vif-plugged", "status": "completed", "tag": "0fd6ab13-839a-4071-a3d1-60b901aea40f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] Creating event network-vif-plugged:0fd6ab13-839a-4071-a3d1-60b901aea40f for instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 on user Nov 28 20:13:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-0fd0e75f-aadd-4e9a-85c9-1ab3da8a7f6d req-40da7c28-dc9e-43ca-b61c-e7b8ddd7e775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Nov 28 20:13:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:13:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-69f3002a-ea0f-4606-801c-f8f5a14f3a1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: .version_select at 0x7f9e64952950>, body: {"keypair": {"name": "tempest-keypair-1082993848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcv8uQz+nR5/2Kyh5iIwf3OHys6PaLMAb2ymkOGNgmsCNHOoLJgjnILAd0z5T3cqhz2i9h9soKwPeCr9xdFkv0bMWCGWMfoC+gS3+jMXGPbetTiYDkWA2a0ddXyoobpZQ=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:57 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-69f3002a-ea0f-4606-801c-f8f5a14f3a1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:13:57 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-69f3002a-ea0f-4606-801c-f8f5a14f3a1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:13:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-69f3002a-ea0f-4606-801c-f8f5a14f3a1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054482 Nov 28 20:13:57 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 76/220] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:13:57 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] HTTP exception thrown: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. Nov 28 20:13:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Returning 404 to user: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:13:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fd568f55-a735-4de5-b62d-3ed373d9cdc2 tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 404 len: 111 microversion: 2.1 time: 0.066449 Nov 28 20:13:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 71/221] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:13:58 2023] DELETE /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] [instance: 42d7a4d5-4d2a-4803-b253-b656aec16f69] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] HTTP exception thrown: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. Nov 28 20:13:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] Returning 404 to user: Instance 42d7a4d5-4d2a-4803-b253-b656aec16f69 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:13:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-041416a0-29a6-4f99-8a79-6a807166d41e tempest-DeleteServersTestJSON-246706357 tempest-DeleteServersTestJSON-246706357-project-member] 10.0.0.210 "GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69" status: 404 len: 111 microversion: 2.1 time: 0.043503 Nov 28 20:13:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 77/222] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:58 2023] GET /compute/v2.1/servers/42d7a4d5-4d2a-4803-b253-b656aec16f69 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:13:58 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "volume-reimaged", "server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "tag": "fa0184f2-4a56-4d02-95cb-f5b41506ed72"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] Creating event volume-reimaged:fa0184f2-4a56-4d02-95cb-f5b41506ed72 for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:13:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e46f23f4-c2f2-41ce-bc28-094f453c3436 req-07961de3-4e57-4f28-ac58-ea54174c905d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.93 time: 0.111429 Nov 28 20:13:58 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 75/223] 10.0.0.210 () {70 vars in 1437 bytes} [Tue Nov 28 20:13:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-966969358", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b"}], "security_groups": [{"name": "tempest-securitygroup--1636273499"}], "key_name": "tempest-keypair-1082993848", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] validate_networks() for [('8cc12ce3-3e35-45e4-bbee-b5d66b5b468b', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:13:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:13:59 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:13:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-408d8003-4be7-426a-8ca7-da95f512339f tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.720901 Nov 28 20:13:59 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 72/224] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:13:59 2023] POST /compute/v2.1/servers => generated 404 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:13:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b22227fe-416b-4f85-9b63-5ec048cf4c23 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:13:59 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b22227fe-416b-4f85-9b63-5ec048cf4c23 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b22227fe-416b-4f85-9b63-5ec048cf4c23 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b22227fe-416b-4f85-9b63-5ec048cf4c23 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1233 microversion: 2.1 time: 0.119184 Nov 28 20:14:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 76/225] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:13:59 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1233 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b9185fba-7cd7-4376-9c97-d357803d7e4b tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.310975 Nov 28 20:14:00 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 78/226] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:13:59 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d/os-interface => generated 1829 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2175aaf2-273f-4056-a367-d7e1a1a83741 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103275 Nov 28 20:14:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 73/227] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:00 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-09c21f35-5891-4ff8-95d0-9516bf9c466e tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058305 Nov 28 20:14:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:00 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lazy-loading 'services' on Instance uuid a3084b80-68e5-44f6-b87d-4f7ad6b31756 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] Creating event network-changed:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3af722ce-0fcf-4cee-baa1-5ce3694e4506 req-63adf01b-01cd-4bfe-b599-3f105c6493f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032362 Nov 28 20:14:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 74/229] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-52acb239-efd7-44a8-99bb-49170075cb76 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/d1537a8f-618a-4dc3-aa95-77f77a33e2fb" status: 202 len: 0 microversion: 2.1 time: 0.255197 Nov 28 20:14:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 79/230] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:14:00 2023] DELETE /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments/d1537a8f-618a-4dc3-aa95-77f77a33e2fb => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1291a126-1e74-4d1d-a5bc-f98435da755b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055628 Nov 28 20:14:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 78/231] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:01 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:02 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:02 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:02 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-880799bb-40cf-4a11-af2a-21a3ce98e868 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 200 len: 2820 microversion: 2.32 time: 1.118490 Nov 28 20:14:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 75/232] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:01 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 2820 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-39dbe594-b161-4b8b-a0d7-0d52be321cb4 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.177432 Nov 28 20:14:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 80/233] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:14:02 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d/os-interface => generated 1829 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] Creating event network-changed:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:14:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-36119413-b039-4411-8d4d-ec03035052ba req-4449dbe2-0aa8-4e06-b60e-c53248ffc95e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032586 Nov 28 20:14:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 79/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:14:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9d2559a8-8b8a-45bf-b0a2-fe8fc6940362 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 204 len: 0 microversion: 2.32 time: 0.149876 Nov 28 20:14:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 76/235] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:14:04 2023] DELETE /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:04 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'be9e9698937848dbb2b073607f73af64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d1a4972442f432da170242f18d528e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2f579f77-c5ef-4d18-806e-f5ad076fdf22 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 200 len: 2945 microversion: 2.32 time: 0.381041 Nov 28 20:14:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 81/236] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:04 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 2945 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "5bdfc240-06a9-47c2-b496-bda3e4931c80"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] Creating event network-vif-unplugged:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-37f85b86-bfd4-41e8-a0b0-059670ee797b req-d05ae24a-d355-418c-bd65-6fb62df292cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044168 Nov 28 20:14:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 77/237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:14:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] Creating event network-vif-unplugged:5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-eefbd2f3-e73b-42e9-a239-7a75c26a905c req-472f1813-0152-4bdf-97c4-5ef7ad98724f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055137 Nov 28 20:14:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] Creating event network-vif-unplugged:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-00b92c2b-6019-4df4-b003-1213dce73a37 req-e97beca8-8315-494f-838c-a38bee59c28f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048941 Nov 28 20:14:05 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 82/239] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "5bdfc240-06a9-47c2-b496-bda3e4931c80"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "1732200a-bf2a-477a-b72e-7191f2ccfb4e"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "1732200a-bf2a-477a-b72e-7191f2ccfb4e"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}, {"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}, {"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-plugged:5bdfc240-06a9-47c2-b496-bda3e4931c80 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-unplugged:1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-plugged:1732200a-bf2a-477a-b72e-7191f2ccfb4e for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-unplugged:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-plugged:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:14:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-449e7f2d-0014-4f22-9919-c944cb092411 req-87895de1-70b2-48cf-ad27-f5b29eb579d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1213 microversion: 2.1 time: 0.036087 Nov 28 20:14:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 78/240] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 20:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 1213 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] Creating event network-vif-plugged:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ee1e6dda-f019-4a15-9626-9ba87a5e8ebe req-0f5f8107-966e-4c63-8551-c50a90c6f8a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031696 Nov 28 20:14:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 81/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-unplugged", "status": "completed", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-plugged", "status": "completed", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Creating event network-vif-plugged:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Creating event network-vif-unplugged:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Creating event network-vif-plugged:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Creating event network-vif-unplugged:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] Creating event network-vif-plugged:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b0f9d3dc-ed1a-4b75-bfd5-cc04f780e7c4 req-54442bf7-e8ce-414c-bc86-94c08abba8e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.037828 Nov 28 20:14:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 83/242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-deleted", "tag": "e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] Creating event network-vif-deleted:e7f10eb6-f4f8-4a11-90bd-fdec53fd4bee for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-40f8f733-77dc-4b1c-975d-6c6c32fd4bb3 req-e949f8a1-7787-41cc-8676-ee97412cd951 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040646 Nov 28 20:14:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 79/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-deleted", "tag": "83928471-88d4-4e3f-bebd-40d53fcfd576"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-deleted", "tag": "a5c9d8f5-1111-4aa6-a962-1f7136a267b0"}, {"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-deleted", "tag": "84e4f0c4-3f04-4c12-8691-9751c9f48d88"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Creating event network-vif-deleted:83928471-88d4-4e3f-bebd-40d53fcfd576 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Creating event network-vif-deleted:a5c9d8f5-1111-4aa6-a962-1f7136a267b0 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] Creating event network-vif-deleted:84e4f0c4-3f04-4c12-8691-9751c9f48d88 for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-9a003ee6-9bde-4d2c-9ecb-1487806a8464 req-effb25e3-f326-43ee-80bb-25561ef98ba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.046486 Nov 28 20:14:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 82/244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:14 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55765bf6-ce98-4e44-b444-afcb250dc54d", "name": "network-vif-deleted", "tag": "fe80e513-5da6-4885-8fce-0bc941bf6b4a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] Creating event network-vif-deleted:fe80e513-5da6-4885-8fce-0bc941bf6b4a for instance 55765bf6-ce98-4e44-b444-afcb250dc54d on user Nov 28 20:14:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-977eb247-4413-4637-9361-0b31448cf6a6 req-d832808e-7ad3-43c1-9f7d-9b56d56515b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033747 Nov 28 20:14:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 84/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-plugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] Creating event network-vif-plugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:14:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-31f167d6-e619-4911-b7c5-a62ecaaaa18f req-279bb92e-ba8c-4f9f-ad66-3591b4b6e357 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036177 Nov 28 20:14:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 80/246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8be492c3-278a-48a5-bbb0-3b36e0872990 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050583 Nov 28 20:14:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 83/247] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:18 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:14:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1259091663", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "3b3bc160-310f-422a-ab1d-d8090334b344"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] validate_networks() for [('3b3bc160-310f-422a-ab1d-d8090334b344', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for project 63ff2e349b40430a91730a22fd4a0487. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Getting quotas for user 0d747c1fd611452f8d0e6ee1b423cd2c and project 63ff2e349b40430a91730a22fd4a0487. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:14:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-38b4566a-f63e-4275-8b05-b00ebf9c04f7 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.561362 Nov 28 20:14:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 85/248] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:14:18 2023] POST /compute/v2.1/servers => generated 378 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-30cdab2e-43c0-45ed-8c7a-b173b3d7db17 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-30cdab2e-43c0-45ed-8c7a-b173b3d7db17 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-30cdab2e-43c0-45ed-8c7a-b173b3d7db17 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-30cdab2e-43c0-45ed-8c7a-b173b3d7db17 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05" status: 200 len: 1210 microversion: 2.1 time: 0.058120 Nov 28 20:14:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 81/249] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:19 2023] GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05 => generated 1210 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-plugged", "status": "completed", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] Creating event network-vif-plugged:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:14:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e7f442cb-c55e-483a-bff5-c3cb168088b3 req-69ca6ee3-b49c-4a0c-b125-aca184404078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046200 Nov 28 20:14:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:14:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ac3d55bd-25f1-4a84-b00d-f640a2adbdd0 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317" status: 204 len: 0 microversion: 2.1 time: 0.218236 Nov 28 20:14:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 86/251] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:14:19 2023] DELETE /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:20 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '637fd3a4988b4f5cbb9507b3e850effa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b6bbaa4bb5b47668fa7beddd9dbcb69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-298a5beb-37d3-43e1-b57c-a9a2ed9e1343 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317" status: 200 len: 1459 microversion: 2.1 time: 0.295725 Nov 28 20:14:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 82/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:19 2023] GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317 => generated 1459 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:21 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902b4e2-d53e-459f-a10e-bcbba4fc2317", "name": "network-vif-deleted", "tag": "3eabc9ee-0a3a-48ec-8956-6036d0217183"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] Creating event network-vif-deleted:3eabc9ee-0a3a-48ec-8956-6036d0217183 for instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 on user Nov 28 20:14:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-a937be0c-5e07-4fcf-b46b-a23ddee89955 req-5b1220ac-8523-4487-9b65-8acfcd80b30b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042238 Nov 28 20:14:21 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:22 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] Creating event network-changed:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:14:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1f842b26-c6b8-4db3-9bd6-cd89c70263e2 req-b2e0e31d-b265-44bc-9b2b-37dae7e2f8ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029580 Nov 28 20:14:22 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 87/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:14:24 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "name": "network-vif-plugged", "status": "completed", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:24 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] Creating event network-vif-plugged:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:14:24 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-753681c3-023f-47e2-be47-523c6f54acfd req-a51c2378-8c22-403f-bfa3-b9edd2faed77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032852 Nov 28 20:14:24 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 83/255] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:25 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4bc57391-0238-4915-ad59-b5cb679c0030 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1859 microversion: 2.93 time: 0.246344 Nov 28 20:14:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:25 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1859 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "name": "network-vif-plugged", "status": "completed", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] Creating event network-vif-plugged:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:14:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-d99da8a9-adcc-4a1f-9730-40870ab30e2e req-38340049-8a7f-4938-9a08-126cf641211c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188722 Nov 28 20:14:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 88/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=129,nova_cell1:INSERT=7,nova_cell1:UPDATE=7,nova_cell1:DELETE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-febe51dd-a277-4759-b043-961d9c01cad4 tempest-VolumesAssistedSnapshotsTest-1427071355 tempest-VolumesAssistedSnapshotsTest-1427071355-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051172 Nov 28 20:14:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 84/258] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:30 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=119,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:14:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a5132b31-df4c-4636-bb90-0bb98e910824 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" status: 204 len: 0 microversion: 2.1 time: 0.169362 Nov 28 20:14:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 87/259] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:14:34 2023] DELETE /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:14:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=102,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-860a7ada-9abb-4cf3-a9c8-74dbcb8b60e4 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" status: 200 len: 1490 microversion: 2.1 time: 0.309324 Nov 28 20:14:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 89/260] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:34 2023] GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 => generated 1490 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "name": "network-vif-unplugged", "status": "completed", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] Creating event network-vif-unplugged:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:14:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:14:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-cf19fc26-18e1-45ae-9475-64b5872052b7 req-ec934d14-7c23-4af8-86aa-635122d3e0a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080684 Nov 28 20:14:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 88/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2b5dde9d-b0f8-438b-a7d3-39240935449d tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710" status: 204 len: 0 microversion: 2.1 time: 0.205208 Nov 28 20:14:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 85/262] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:14:35 2023] DELETE /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "name": "network-vif-unplugged", "status": "completed", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:36 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5d0e5911d94f0c96e5065db9729740', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16b1448d67fd4c94a0d1374ed792b428', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b8600d6d-b5f3-4787-aeaa-f51e0418c6d1 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710" status: 200 len: 1672 microversion: 2.1 time: 0.579087 Nov 28 20:14:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:35 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710 => generated 1672 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] Creating event network-vif-unplugged:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:14:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3134ce34-4316-4dcc-b8b3-6ade8ef35ee7 req-a3b435d8-eea0-4047-9ffa-692b805e8b12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049374 Nov 28 20:14:36 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 89/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "name": "network-vif-deleted", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] Creating event network-vif-deleted:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:14:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a3e047db-f74e-4e8b-8cd2-52b5c235222d req-8672fcf0-05fa-4a5a-bb66-54645ce7fd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050824 Nov 28 20:14:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 86/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6", "name": "network-vif-plugged", "status": "completed", "tag": "a1d9020e-bbea-4ca9-8cc9-e4c684b47aac"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-98096ae3-99b2-415e-8628-cc6ef06bdda9 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Action: 'create', calling method: .version_select at 0x7f9e65373e20>, body: {"keypair": {"name": "tempest-keypair-1759875013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaSx1jZZHc656I2djYi3DhPKTXjWcOp0L/Ds5XrrQTGIaqXD0RaHaJbxrTUjv6e2JpdBSSTWCxZr4LUPlq4gCbPt+9nKc8rivC5sciIHXb+fhBWaWVHbiseHG5HB7Z+sQ=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] Creating event network-vif-plugged:a1d9020e-bbea-4ca9-8cc9-e4c684b47aac for instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 on user Nov 28 20:14:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-5981c030-770a-4a20-ba3d-593026ed4db6 req-372a2db7-7259-46ea-81af-df141f19f76c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037010 Nov 28 20:14:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 91/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:37 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-98096ae3-99b2-415e-8628-cc6ef06bdda9 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting quotas for project 573c587fe3af43a5a01c4e5db0643075. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:14:37 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-98096ae3-99b2-415e-8628-cc6ef06bdda9 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting quotas for user d826645c8f4f4ce7bb0cf606d9005ed2 and project 573c587fe3af43a5a01c4e5db0643075. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:14:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-98096ae3-99b2-415e-8628-cc6ef06bdda9 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.046917 Nov 28 20:14:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 90/267] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:14:37 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Nov 28 20:14:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "name": "network-vif-plugged", "status": "completed", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] Creating event network-vif-plugged:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:14:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-e1d67a64-9c18-4b75-83a6-8c7b9c584acd req-335677cd-fb8c-48ae-8801-0d9544fa6030 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028719 Nov 28 20:14:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 87/268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "415392e8-bf6c-433e-a4f5-be3d99419710", "name": "network-vif-deleted", "tag": "317f4a0e-b709-4696-9a61-0c8067789331"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] Creating event network-vif-deleted:317f4a0e-b709-4696-9a61-0c8067789331 for instance 415392e8-bf6c-433e-a4f5-be3d99419710 on user Nov 28 20:14:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-4e83fca1-fe8a-4123-a85a-5c60fa8775a0 req-11933fd1-102e-479a-ab31-c6cdc94224fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030148 Nov 28 20:14:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 92/269] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-669424600", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "f4277af4-8e9c-4147-9ca9-2cf286d9de49"}, {"port": "13d2eb0a-77c7-4db6-96c1-547dc7781057", "tag": "port-1"}, {"port": "2eb26bff-1c84-413b-b3b4-fbc18940f912", "tag": "port-2"}, {"uuid": "9c1ab26c-548b-4032-8215-a2e67035b811", "tag": "net-1"}, {"uuid": "9c1ab26c-548b-4032-8215-a2e67035b811"}, {"uuid": "5a401ccf-f76c-407a-8684-f55009848833", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "5a401ccf-f76c-407a-8684-f55009848833", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "037b5b30-bff1-4d62-b6b5-21a93e3891a4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "4d17e45e-920e-43e3-a502-1047571c3c0a", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "24f35406-cae5-4853-b197-f772e12de0b3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1384311694"}], "key_name": "tempest-keypair-1759875013", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:39 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] validate_networks() for [('f4277af4-8e9c-4147-9ca9-2cf286d9de49', None, None, None, None, None), (None, None, '13d2eb0a-77c7-4db6-96c1-547dc7781057', None, None, None), (None, None, '2eb26bff-1c84-413b-b3b4-fbc18940f912', None, None, None), ('9c1ab26c-548b-4032-8215-a2e67035b811', None, None, None, None, None), ('9c1ab26c-548b-4032-8215-a2e67035b811', None, None, None, None, None), ('5a401ccf-f76c-407a-8684-f55009848833', '10.2.2.100', None, None, None, None), ('5a401ccf-f76c-407a-8684-f55009848833', '10.2.2.200', None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting quotas for project 573c587fe3af43a5a01c4e5db0643075. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Getting quotas for user d826645c8f4f4ce7bb0cf606d9005ed2 and project 573c587fe3af43a5a01c4e5db0643075. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:14:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='037b5b30-bff1-4d62-b6b5-21a93e3891a4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='4d17e45e-920e-43e3-a502-1047571c3c0a',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24f35406-cae5-4853-b197-f772e12de0b3',volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:14:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-204e98e4-2fdf-4c82-9273-db0dcd937a24 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 2.178411 Nov 28 20:14:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 91/270] 10.0.0.210 () {66 vars in 1266 bytes} [Tue Nov 28 20:14:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:14:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:41 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ae0fb9b5-c2bb-47f0-9831-79be5da5573b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 200 len: 1277 microversion: 2.42 time: 0.067296 Nov 28 20:14:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 88/271] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:41 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 1277 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] HTTP exception thrown: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. Nov 28 20:14:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Returning 404 to user: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1e60d567-84ad-476e-a729-240b10128bba tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 404 len: 111 microversion: 2.1 time: 0.029467 Nov 28 20:14:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 93/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:42 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:14:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-35591268-fb1e-4a75-9ecf-e76aece9daf7 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '.version_select at 0x7f9e64717010>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-35591268-fb1e-4a75-9ecf-e76aece9daf7 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011383959" status: 202 len: 0 microversion: 2.1 time: 0.028316 Nov 28 20:14:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 92/273] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:14:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1011383959 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:14:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] Creating event network-changed:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-52e4df1c-79e0-4697-aacc-cfe6c3db3454 req-13752ff5-472a-4d3c-a8e3-dca88db715c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038640 Nov 28 20:14:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 89/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] HTTP exception thrown: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. Nov 28 20:14:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Returning 404 to user: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-949239c6-e777-4da2-ad59-9c67929f6269 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 404 len: 111 microversion: 2.1 time: 0.033470 Nov 28 20:14:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 94/275] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:14:46 2023] DELETE /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] [instance: 958252cc-398e-4cc6-bd8d-937c99ef2b70] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] HTTP exception thrown: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. Nov 28 20:14:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] Returning 404 to user: Instance 958252cc-398e-4cc6-bd8d-937c99ef2b70 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b046728d-5b57-4ce0-a882-f0937cfed313 tempest-AttachSCSIVolumeTestJSON-2114135896 tempest-AttachSCSIVolumeTestJSON-2114135896-project-member] 10.0.0.210 "GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70" status: 404 len: 111 microversion: 2.1 time: 0.042057 Nov 28 20:14:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 93/276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:46 2023] GET /compute/v2.1/servers/958252cc-398e-4cc6-bd8d-937c99ef2b70 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:14:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "13d2eb0a-77c7-4db6-96c1-547dc7781057"}, {"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "2eb26bff-1c84-413b-b3b4-fbc18940f912"}, {"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Creating event network-changed:13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Creating event network-changed:2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] Creating event network-changed:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a80aa955-b069-4f49-9a7d-fbbb27fe6c51 req-10f48fda-6c92-48c8-97db-1b9d1a6ecaa2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.051737 Nov 28 20:14:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 90/277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] Creating event network-changed:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-61cb48ef-0184-4f67-822c-3d2842869fc4 req-c8647dcf-6689-4f00-9010-dc6a68bc4a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035784 Nov 28 20:14:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 94/278] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:49 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d873ec7a-97a5-40c2-be8b-334bf3969bb7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 200 len: 1534 microversion: 2.1 time: 0.391869 Nov 28 20:14:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 95/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:48 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 1534 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:50 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c859f422-452a-4507-ab85-b174a5cb5f4a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1541 microversion: 2.1 time: 0.333341 Nov 28 20:14:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 91/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:50 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}, {"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Creating event network-changed:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] Creating event network-changed:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:14:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5ae3df0e-5e3a-44e5-9563-2c1eaabb5434 req-5b31af23-7702-48e7-8893-7b292ada3418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033448 Nov 28 20:14:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 95/281] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-de9caa8f-89a8-4a3b-85f0-1abd80792a4b tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046244 Nov 28 20:14:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 96/282] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:14:51 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:14:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4c0a7a4a-b32c-4f1f-9b73-dbd098fe1374 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756" status: 204 len: 0 microversion: 2.1 time: 0.278051 Nov 28 20:14:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 92/283] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:14:51 2023] DELETE /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] Creating event network-changed:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:14:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-759d17c6-9a0b-411d-a0ea-27e2e82d49cb req-322934e6-b3ed-4d18-ace2-3937b86043b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044266 Nov 28 20:14:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 97/284] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:51 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c5dbb5a65014af3b72843ad4fccd06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f356c386b1804c90ad27fd57bf6961ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:14:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b23338db-ed89-469d-a3cd-fff1643ab16f tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756" status: 200 len: 1649 microversion: 2.1 time: 0.385861 Nov 28 20:14:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:14:51 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756 => generated 1649 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55971858-8dd0-45f6-ba68-a481db871e91"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3dcb0159-2507-4a23-a9e0-3ff566ec7baf tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.365578 Nov 28 20:14:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 93/286] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:14:52 2023] POST /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "name": "network-vif-unplugged", "status": "completed", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}, {"server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "name": "network-vif-plugged", "status": "completed", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Creating event network-vif-unplugged:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:14:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] Creating event network-vif-plugged:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:14:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-efb5b02d-9924-45f1-b78b-2fa71c94c89e req-0131166f-9b40-4d09-9bc0-33d08b715831 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031255 Nov 28 20:14:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3084b80-68e5-44f6-b87d-4f7ad6b31756", "name": "network-vif-deleted", "tag": "6ec42ed1-ea9b-462e-b695-22222a022c1d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:14:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] Creating event network-vif-deleted:6ec42ed1-ea9b-462e-b695-22222a022c1d for instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 on user Nov 28 20:14:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6696d2b7-b336-401f-b94b-eb9ca30ac761 req-bfdd94d8-8bd1-497a-9ad8-dfa685bae38c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055506 Nov 28 20:14:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 97/288] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:14:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HTTP exception thrown: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. Nov 28 20:14:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Returning 404 to user: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7a38b9fe-fa75-4e2e-8c19-9f7852a16894 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 404 len: 111 microversion: 2.32 time: 0.035457 Nov 28 20:14:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 94/289] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:54 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:14:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-df17cd47-3613-4ed5-a581-b7d326a9f81a tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '.version_select at 0x7f9e6475d000>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-df17cd47-3613-4ed5-a581-b7d326a9f81a tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642922695" status: 204 len: 0 microversion: 2.32 time: 0.029346 Nov 28 20:14:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 99/290] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 20:14:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642922695 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HTTP exception thrown: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. Nov 28 20:14:57 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Returning 404 to user: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1a1bdbea-de77-4131-9776-d5b24aaccdc7 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 404 len: 111 microversion: 2.32 time: 0.030778 Nov 28 20:14:57 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 98/291] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:14:57 2023] DELETE /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] [instance: 55765bf6-ce98-4e44-b444-afcb250dc54d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:14:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] HTTP exception thrown: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. Nov 28 20:14:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] Returning 404 to user: Instance 55765bf6-ce98-4e44-b444-afcb250dc54d could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:14:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c26b7031-bd53-4fec-8280-501c0ed069b3 tempest-TaggedBootDevicesTest-1933440292 tempest-TaggedBootDevicesTest-1933440292-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d" status: 404 len: 111 microversion: 2.32 time: 0.039290 Nov 28 20:14:57 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 95/292] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:14:57 2023] GET /compute/v2.1/servers/55765bf6-ce98-4e44-b444-afcb250dc54d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=35 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:04 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'services' on Instance uuid a8112c4a-cb42-49df-81a7-97b42f5cc87d {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:15:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6be1747e-7ed9-4b07-bd68-9094241fd6e2 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments/55971858-8dd0-45f6-ba68-a481db871e91" status: 202 len: 0 microversion: 2.1 time: 0.187210 Nov 28 20:15:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 100/293] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:15:04 2023] DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments/55971858-8dd0-45f6-ba68-a481db871e91 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f6c2c531-8a41-40ab-a092-f05abfd24c67 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048095 Nov 28 20:15:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:15:04 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-83f668cb-9808-4257-b9ba-5bc4844c6b4a tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05" status: 200 len: 1495 microversion: 2.1 time: 0.256294 Nov 28 20:15:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 96/295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:09 2023] GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05 => generated 1495 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] [instance: e902b4e2-d53e-459f-a10e-bcbba4fc2317] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] HTTP exception thrown: Instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 could not be found. Nov 28 20:15:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] Returning 404 to user: Instance e902b4e2-d53e-459f-a10e-bcbba4fc2317 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:15:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e0cf4c6e-fbfc-4c9f-8331-554f1038ab21 tempest-VolumesNegativeTest-300076032 tempest-VolumesNegativeTest-300076032-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317" status: 404 len: 111 microversion: 2.1 time: 0.036593 Nov 28 20:15:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 101/296] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:10 2023] GET /compute/v2.1/servers/e902b4e2-d53e-459f-a10e-bcbba4fc2317 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:15:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1b11cbe9-3362-4099-bdc6-562ef6cdf6ee tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Action: 'create', calling method: .version_select at 0x7f9e646579a0>, body: {"keypair": {"name": "tempest-keypair-1640947232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJygV2sBwSu97x/mNv3tb+z8vi+uhgqoT2QUgvIa02FX6CxSOX0/P5GPCbQ7xDIoAjiVsAURNLlcT6927/eZSkKqdRK7mwgjh5qS2dEgtINUouxWTKkh2D8D/z/+oLMOWQ=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:13 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-1b11cbe9-3362-4099-bdc6-562ef6cdf6ee tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting quotas for project 82eb04f7bcf944c58f07769918fb18ed. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:15:13 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-1b11cbe9-3362-4099-bdc6-562ef6cdf6ee tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting quotas for user 3de9c75fa13b4cfdaa348ed6e28e9d97 and project 82eb04f7bcf944c58f07769918fb18ed. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:15:13 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1b11cbe9-3362-4099-bdc6-562ef6cdf6ee tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.068080 Nov 28 20:15:13 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 100/297] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:15:13 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 70 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:15:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] Creating event network-vif-plugged:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0b6bdb80-5345-4d3c-9f63-9e37b0c09046 req-883fdee8-14e3-49e3-8a08-fecc2b521d51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063295 Nov 28 20:15:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 97/298] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "2eb26bff-1c84-413b-b3b4-fbc18940f912"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] Creating event network-vif-plugged:2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7e58977c-d4f2-4096-8785-8163e0ef8265 req-a0dde3c0-810c-428c-85ec-1712e59b9084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044247 Nov 28 20:15:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 102/299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] Creating event network-vif-plugged:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-482a00da-55a8-4fdb-94d4-cdadfe18b0af req-71daba02-aa0f-46da-9b03-9f046da0ea2f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Nov 28 20:15:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-314385621", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "config_drive": true, "networks": [{"uuid": "268f60cb-1235-41c9-88d5-7b68c1de2795"}], "security_groups": [{"name": "tempest-securitygroup--856791426"}], "key_name": "tempest-keypair-1640947232", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "13d2eb0a-77c7-4db6-96c1-547dc7781057"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "13d2eb0a-77c7-4db6-96c1-547dc7781057"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Creating event network-vif-plugged:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Creating event network-vif-plugged:13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Creating event network-vif-plugged:13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Creating event network-vif-plugged:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] Creating event network-vif-plugged:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-825decfd-1dae-444a-9556-c013e6e2559f req-4dfcffd8-7ea5-4a0e-ba2b-cfc02569cb9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034976 Nov 28 20:15:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 103/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:15 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:15 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] validate_networks() for [('268f60cb-1235-41c9-88d5-7b68c1de2795', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting quotas for project 82eb04f7bcf944c58f07769918fb18ed. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Getting quotas for user 3de9c75fa13b4cfdaa348ed6e28e9d97 and project 82eb04f7bcf944c58f07769918fb18ed. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ace2843b-38b1-4e1d-94a5-0cfd2ab9b657 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.49 time: 0.737211 Nov 28 20:15:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 98/302] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:15:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:15:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:16 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:16 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:16 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8b953494-3c9e-4692-9e10-a9b735c8a784 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 200 len: 1320 microversion: 2.49 time: 0.115637 Nov 28 20:15:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "2eb26bff-1c84-413b-b3b4-fbc18940f912"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 102/303] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:15:16 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 1320 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:15:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] Creating event network-vif-plugged:2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ea055542-abfd-49fe-9cb7-d01d61d77545 req-05c66bea-a128-458a-8e46-435f10495b96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031680 Nov 28 20:15:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 104/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Creating event network-vif-plugged:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Creating event network-vif-plugged:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Creating event network-vif-plugged:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Creating event network-vif-plugged:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] Creating event network-vif-plugged:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:15:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-fddaa7a3-e894-4aa5-9338-909410a51893 req-055bfd3b-672a-4936-b069-bfacfa40a119 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.034034 Nov 28 20:15:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 99/305] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:16 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] Creating event network-changed:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:15:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-9e45da63-5185-4127-b1f3-53a76602a88c req-5b4c6983-9b8c-4441-afc0-7b0098906771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068455 Nov 28 20:15:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 103/306] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] Creating event network-vif-plugged:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:15:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-eca34c33-29e2-4bb6-8692-77d4a4e958af req-2a7394b7-ca07-4f79-b205-46dc44d17620 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047061 Nov 28 20:15:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] Creating event network-vif-plugged:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:15:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-8be45b5e-89fc-4c99-9fb9-d33d211d3f1e req-7d3ad0e5-82b0-44f2-a180-65b735add47d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041118 Nov 28 20:15:23 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 100/308] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] HTTP exception thrown: Instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 could not be found. Nov 28 20:15:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Returning 404 to user: Instance 8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:15:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9da37a4c-143f-420c-bee3-8576ac75aebc tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6" status: 404 len: 111 microversion: 2.1 time: 0.046455 Nov 28 20:15:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:25 2023] GET /compute/v2.1/servers/8b28dc6c-31ec-4b50-901e-4e1a2e00d9c6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:15:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-489468757", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "00de1a40-1743-4c1d-a032-0ae863c7e009"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:25 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] validate_networks() for [('00de1a40-1743-4c1d-a032-0ae863c7e009', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-46d4bdc2-304a-48e8-81b3-353bbfe1bb79 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1859 microversion: 2.93 time: 0.356760 Nov 28 20:15:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 101/310] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:15:25 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1859 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] [instance: 415392e8-bf6c-433e-a4f5-be3d99419710] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] HTTP exception thrown: Instance 415392e8-bf6c-433e-a4f5-be3d99419710 could not be found. Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Returning 404 to user: Instance 415392e8-bf6c-433e-a4f5-be3d99419710 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:15:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-62cc5f2c-8cd3-4544-9409-ef05fc56afee tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710" status: 404 len: 111 microversion: 2.1 time: 0.030188 Nov 28 20:15:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 105/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:26 2023] GET /compute/v2.1/servers/415392e8-bf6c-433e-a4f5-be3d99419710 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-97477cdd-736a-4ef3-b517-d1b5f31800c5 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] Calling method '.version_select at 0x7f9e64644f70>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-97477cdd-736a-4ef3-b517-d1b5f31800c5 tempest-VolumesAssistedSnapshotsTest-1397496501 tempest-VolumesAssistedSnapshotsTest-1397496501-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-448215708" status: 202 len: 0 microversion: 2.1 time: 0.024347 Nov 28 20:15:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 102/312] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:15:26 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-448215708 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting quotas for project bed5b9f19e584ca5bd8bf2d75b5ee765. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Getting quotas for user 854e01c9d8d644299bbf6b9a18e00fcd and project bed5b9f19e584ca5bd8bf2d75b5ee765. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:15:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b583afe1-d671-44b7-af65-19688266ba08 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.820570 Nov 28 20:15:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 106/313] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:15:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0231c3ff-132c-4370-bbbb-54a57f3ac852 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0231c3ff-132c-4370-bbbb-54a57f3ac852 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-0231c3ff-132c-4370-bbbb-54a57f3ac852 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:15:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0231c3ff-132c-4370-bbbb-54a57f3ac852 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823" status: 200 len: 1205 microversion: 2.1 time: 0.128676 Nov 28 20:15:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 106/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:26 2023] GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823 => generated 1205 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-31d2bed9-31bd-4128-a364-7bf56f391413 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 204 len: 0 microversion: 2.93 time: 0.215354 Nov 28 20:15:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 103/315] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:15:26 2023] DELETE /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-987568f4-56ef-40a9-800b-ba7774c8fc14 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Action: 'create', calling method: .version_select at 0x7f9e64655240>, body: {"keypair": {"name": "tempest-keypair-1179232993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGleHnng/iZf+pKcaRfN4ki3/kKcZ1lAUwQTncf758ioT4v9Nu4+2KyDgP5bUFKo8JEMegAuoMjbKaD/3O2Xdr1tfYfEaBfckP1a0BpsnLhWEjCdte2x0agDjBhSwM7chQ=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:27 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-987568f4-56ef-40a9-800b-ba7774c8fc14 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for project 8895df748b4644e9bad362ea318e04c7. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:15:27 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-987568f4-56ef-40a9-800b-ba7774c8fc14 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for user 0ffae0c69e0c40e0917cf412e7757616 and project 8895df748b4644e9bad362ea318e04c7. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:15:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-987568f4-56ef-40a9-800b-ba7774c8fc14 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.286265 Nov 28 20:15:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 107/316] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:15:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:27 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:27 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:27 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd313e776858a411ea463adecd1f36819', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fed1996731e94c8eb5c16e6327b32f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9b7633ce-e33f-4d17-96c9-8156bc27170d tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 200 len: 1865 microversion: 2.93 time: 0.838466 Nov 28 20:15:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 107/317] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:15:26 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 1865 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:15:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] Creating event network-changed:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:15:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-902a6081-75a2-4c57-a289-ff3ac8dde0b6 req-1a5f2b0e-e0dd-4c18-902d-034337cb7fe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045324 Nov 28 20:15:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 104/318] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a360a3-bce3-4673-b79e-cd0460d2a69a", "name": "network-vif-deleted", "tag": "d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] Creating event network-vif-deleted:d1934d1e-ff23-4c6f-bec5-cb3289ae0d0c for instance 59a360a3-bce3-4673-b79e-cd0460d2a69a on user Nov 28 20:15:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-054b1ec5-41a5-4eaa-b6ac-64f6029ebee5 req-4f6c7ee1-492b-4d6b-805c-623c6f7b7e6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062931 Nov 28 20:15:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 108/319] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherB-server-2039159279", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "56875171-7787-4f2e-901e-cfe332991835"}], "security_groups": [{"name": "tempest-securitygroup--1730343219"}], "key_name": "tempest-keypair-1179232993", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:30 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] validate_networks() for [('56875171-7787-4f2e-901e-cfe332991835', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for project 8895df748b4644e9bad362ea318e04c7. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for user 0ffae0c69e0c40e0917cf412e7757616 and project 8895df748b4644e9bad362ea318e04c7. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:15:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:15:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1e3c0a5d-c101-42a2-9833-3d2bb95eead2 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.086742 Nov 28 20:15:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 108/320] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:15:30 2023] POST /compute/v2.1/servers => generated 407 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:15:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ab0f89fc-eae7-4f27-8e60-268cf8a188bb tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:31 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ab0f89fc-eae7-4f27-8e60-268cf8a188bb tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:31 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-837ea1b0-d324-41ba-a3ab-00b33cd9da43 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 200 len: 2826 microversion: 2.42 time: 0.725164 Nov 28 20:15:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 105/321] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:15:31 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 2826 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:15:32 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ab0f89fc-eae7-4f27-8e60-268cf8a188bb tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ab0f89fc-eae7-4f27-8e60-268cf8a188bb tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1233 microversion: 2.1 time: 0.180557 Nov 28 20:15:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 109/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:31 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1233 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:15:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "name": "network-vif-plugged", "status": "completed", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] Creating event network-vif-plugged:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:15:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b167e356-329c-42f7-a0c6-b813071b7466 req-e9686df8-7e66-40e4-a3e5-f06bb60b3e59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068432 Nov 28 20:15:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 109/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:15:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "name": "network-vif-plugged", "status": "completed", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] Creating event network-vif-plugged:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:15:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-9933c64d-13a6-4319-a8e1-edba36560fb8 req-1244bb9e-bb59-4d90-be50-0ba51ebf750c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061559 Nov 28 20:15:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 106/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:37 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] Creating event network-changed:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:15:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-c5a3bd3a-1de6-46e8-acf7-3d91b7d091e8 req-42abde45-19a7-4903-897c-c4a652edd776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047405 Nov 28 20:15:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 110/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:40 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:15:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1f9762fa-bfa9-43bf-b78a-2ff93fd0b243 req-0098a727-c3fc-4eed-b4f4-b9e9c4097cff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046575 Nov 28 20:15:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 110/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] [instance: a3084b80-68e5-44f6-b87d-4f7ad6b31756] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] HTTP exception thrown: Instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 could not be found. Nov 28 20:15:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Returning 404 to user: Instance a3084b80-68e5-44f6-b87d-4f7ad6b31756 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:15:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-38ad865a-b04d-4f9e-aec1-b53a98f55710 tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756" status: 404 len: 111 microversion: 2.1 time: 0.057421 Nov 28 20:15:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 107/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:42 2023] GET /compute/v2.1/servers/a3084b80-68e5-44f6-b87d-4f7ad6b31756 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:15:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f3c01750-f9e5-4b80-ae25-b7097875c2de tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] Calling method '.version_select at 0x7f9e64657f40>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f3c01750-f9e5-4b80-ae25-b7097875c2de tempest-TestVolumeSwap-2014144021 tempest-TestVolumeSwap-2014144021-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029990611" status: 202 len: 0 microversion: 2.1 time: 0.035271 Nov 28 20:15:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 111/328] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:15:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1029990611 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:15:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-2cb9af80-3cba-4371-a999-146a5d7fb489 req-4de3b3ac-04a8-4298-9e37-f7028aada8df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057190 Nov 28 20:15:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 111/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fcdeaf33-753a-4981-841a-7bfc275bd211 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-interface" status: 200 len: 282 microversion: 2.1 time: 1.026055 Nov 28 20:15:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 108/330] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:15:50 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-interface => generated 282 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] Creating event network-changed:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:15:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-403c57de-b648-4639-80b1-b88dc7d4a5ea req-36aadf06-c175-4470-a10c-d282124eb3bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070880 Nov 28 20:15:52 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:53 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:15:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a16c5454-db89-4059-b2c4-1dc0f0c8e588 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1541 microversion: 2.1 time: 0.619371 Nov 28 20:15:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 112/332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:15:53 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1541 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be8885e7-c3ff-4344-ba63-87e0e83cf851"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9f012e3f-ba9b-48f1-9262-ad29c14e8678 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.583458 Nov 28 20:15:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 109/333] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:15:53 2023] POST /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments => generated 194 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0da177e8-22d5-46ef-9db2-359e82fc0e11 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073292 Nov 28 20:15:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 113/334] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:15:54 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-1853734182"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:15:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:15:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-86f46ecc-9081-447e-a07a-c94f983e436d tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/action" status: 202 len: 0 microversion: 2.1 time: 0.975505 Nov 28 20:15:59 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 113/335] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:15:58 2023] POST /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/action => generated 0 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:05 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5b2d5fb7-a759-4bf6-a464-a035682b2517 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1705 microversion: 2.1 time: 0.377781 Nov 28 20:16:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 110/336] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:05 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1705 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestOtherA-server-1075406910", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: dict_keys(['metadata_items']) {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: dict_keys(['metadata_items']) {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-5050b7cd-2e15-4296-acba-2d518d6e26a3 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/action" status: 202 len: 1160 microversion: 2.1 time: 0.830156 Nov 28 20:16:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 114/337] 10.0.0.210 () {64 vars in 1356 bytes} [Tue Nov 28 20:16:05 2023] POST /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/action => generated 1160 bytes in 834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:06 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a261e23a-2f84-428f-a025-d4bf821bbee2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1733 microversion: 2.1 time: 0.192080 Nov 28 20:16:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 111/338] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:06 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1733 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:06 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5aef93ee-c3e4-46ad-ba50-3fa31dea450d tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 200 len: 1625 microversion: 2.49 time: 0.303399 Nov 28 20:16:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:16:06 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 1625 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:16:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-619b7aca-a6de-4a33-a363-1ed114f16329 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e6455eef0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-619b7aca-a6de-4a33-a363-1ed114f16329 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5c4504bc-3e69-4954-b942-86b82dba8b3d" status: 200 len: 351 microversion: 2.1 time: 0.088815 Nov 28 20:16:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:16:07 2023] GET /compute/v2.1/os-volumes/5c4504bc-3e69-4954-b942-86b82dba8b3d => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] Creating event network-vif-unplugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:16:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-2d7d8032-e510-43d3-91e6-293ac9ecdb58 req-88afd449-5caf-440b-a775-d74620afdcf5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173189 Nov 28 20:16:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 112/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-246226610", "imageRef": "7a729520-30cc-462f-9b0b-638e92e6c4b9", "flavorRef": "1", "key_name": "tempest-TestStampPattern-550063434", "security_groups": [{"name": "tempest-secgroup-smoke-2066102401"}], "networks": [{"uuid": "3f7305f6-e668-4fc6-82bd-f6f519c2bd85"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] validate_networks() for [('3f7305f6-e668-4fc6-82bd-f6f519c2bd85', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:16:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:16:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-f0c5503a-2580-482f-9adc-286486740414 req-0b9053d7-372a-4760-933d-56f2b05cf631 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056669 Nov 28 20:16:09 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 116/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for project 742419219fb94804bef60efd10716a41. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Getting quotas for user 29664fb367db470abbd15cfbf39dd38a and project 742419219fb94804bef60efd10716a41. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:16:09 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a729520-30cc-462f-9b0b-638e92e6c4b9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:16:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b4d14b78-720f-4139-9dd1-2f1985ee9431 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.820650 Nov 28 20:16:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 115/343] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:16:09 2023] POST /compute/v2.1/servers => generated 404 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:16:10 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-00ba49c1-9051-473c-bf02-ffe4b124dce4 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:10 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-00ba49c1-9051-473c-bf02-ffe4b124dce4 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:10 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-00ba49c1-9051-473c-bf02-ffe4b124dce4 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:10 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-00ba49c1-9051-473c-bf02-ffe4b124dce4 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 200 len: 1233 microversion: 2.1 time: 0.081913 Nov 28 20:16:10 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 113/344] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:10 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 1233 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9f08b7e2-3fe5-4ccf-be3c-7387014addea tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e6455e290>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9f08b7e2-3fe5-4ccf-be3c-7387014addea tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d6238c69-51c5-4b66-9038-ab416e83589a" status: 200 len: 351 microversion: 2.1 time: 0.096547 Nov 28 20:16:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 117/345] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:16:10 2023] GET /compute/v2.1/os-volumes/d6238c69-51c5-4b66-9038-ab416e83589a => generated 351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "08b2cbbd-265d-444f-b453-f140f84e24c4"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] HTTP exception thrown: Volume bd1e5036-328b-41f8-a5ba-11752e08bcc5 could not be found. Nov 28 20:16:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] Returning 404 to user: Volume bd1e5036-328b-41f8-a5ba-11752e08bcc5 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:16:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-19ac5657-0648-41a3-a9ea-4103d486705b tempest-VolumesAdminNegativeTest-236937414 tempest-VolumesAdminNegativeTest-236937414-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05/os-volume_attachments/bd1e5036-328b-41f8-a5ba-11752e08bcc5" status: 404 len: 109 microversion: 2.1 time: 0.112630 Nov 28 20:16:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 116/346] 10.0.0.210 () {64 vars in 1510 bytes} [Tue Nov 28 20:16:12 2023] PUT /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05/os-volume_attachments/bd1e5036-328b-41f8-a5ba-11752e08bcc5 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0f4af1e8-64dc-4275-b202-87956bfce5e3 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e6446f9a0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0f4af1e8-64dc-4275-b202-87956bfce5e3 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/62a2c768-ea8f-4174-973b-7e9ce5f3e317" status: 200 len: 350 microversion: 2.1 time: 0.093007 Nov 28 20:16:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 114/347] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes/62a2c768-ea8f-4174-973b-7e9ce5f3e317 => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a777d049-3b8b-4280-81bd-84299fe19fda tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e645e7010>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a777d049-3b8b-4280-81bd-84299fe19fda tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.105873 Nov 28 20:16:13 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 118/348] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1f82e97f-7114-4d41-a72e-db35016563ba tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e646f8ee0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1f82e97f-7114-4d41-a72e-db35016563ba tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102915 Nov 28 20:16:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1226 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c8a492d6-796e-46ae-9998-f0b03affc868 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e645439a0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c8a492d6-796e-46ae-9998-f0b03affc868 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.167836 Nov 28 20:16:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 115/350] 10.0.0.210 () {62 vars in 1211 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2bbf0200-456c-4d2d-836d-b0eba5b02ba3 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e64717a30>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2bbf0200-456c-4d2d-836d-b0eba5b02ba3 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.120956 Nov 28 20:16:13 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 119/351] 10.0.0.210 () {62 vars in 1244 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-757d3855-1923-420b-9495-7f5a70045e11 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e646f89d0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-757d3855-1923-420b-9495-7f5a70045e11 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.098441 Nov 28 20:16:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 118/352] 10.0.0.210 () {62 vars in 1247 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-33f0fca0-84b4-4cc6-b33c-203dda4c7106 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e6446e5f0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-33f0fca0-84b4-4cc6-b33c-203dda4c7106 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086532 Nov 28 20:16:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 116/353] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 20:16:13 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:16:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0590080a-f970-4b14-9e98-e1e048ac23d5 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e645e40d0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0590080a-f970-4b14-9e98-e1e048ac23d5 tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.101718 Nov 28 20:16:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 120/354] 10.0.0.210 () {62 vars in 1265 bytes} [Tue Nov 28 20:16:14 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d3024cb8-3715-4113-ae79-d8caa77eb39d tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] Calling method '.version_select at 0x7f9e646faf80>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d3024cb8-3715-4113-ae79-d8caa77eb39d tempest-VolumesTestJSON-430749993 tempest-VolumesTestJSON-430749993-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.116832 Nov 28 20:16:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 119/355] 10.0.0.210 () {62 vars in 1232 bytes} [Tue Nov 28 20:16:14 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] Creating event network-changed:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:16:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0298f7a0-b7ba-4c03-bc1f-d5318087fc74 req-8494c41c-7891-4c40-a4e7-86a2600ede52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041927 Nov 28 20:16:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 117/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:16 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0768198c-eea5-491a-bdd7-5ccc70c330b6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823" status: 200 len: 1484 microversion: 2.1 time: 0.287969 Nov 28 20:16:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 121/357] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:16 2023] GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823 => generated 1484 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:16:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4408b48e-29c6-4919-bd5b-22073d8c7b9c tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05" status: 204 len: 0 microversion: 2.1 time: 0.167430 Nov 28 20:16:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:16:17 2023] DELETE /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bfcdb07c-7280-4cce-ab25-e8270e01764e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05" status: 200 len: 1501 microversion: 2.1 time: 0.322574 Nov 28 20:16:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 118/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:17 2023] GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05 => generated 1501 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] [instance: 59a360a3-bce3-4673-b79e-cd0460d2a69a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "name": "network-vif-unplugged", "status": "completed", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] HTTP exception thrown: Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a could not be found. Nov 28 20:16:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Returning 404 to user: Instance 59a360a3-bce3-4673-b79e-cd0460d2a69a could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:16:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-dd6345e1-2bfa-4eac-ac2c-f43d37b42cc6 tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a" status: 404 len: 111 microversion: 2.93 time: 0.341650 Nov 28 20:16:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 122/360] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:16:17 2023] GET /compute/v2.1/servers/59a360a3-bce3-4673-b79e-cd0460d2a69a => generated 111 bytes in 343 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:16:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:18 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-33073da3-c89c-4035-9e2f-d8cfd75b46ee tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] Calling method '.version_select at 0x7f9e64647760>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] Creating event network-vif-unplugged:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:16:18 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-33073da3-c89c-4035-9e2f-d8cfd75b46ee tempest-ServerActionsV293TestJSON-323010200 tempest-ServerActionsV293TestJSON-323010200-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302784070" status: 204 len: 0 microversion: 2.93 time: 0.022496 Nov 28 20:16:18 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 119/361] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 20:16:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302784070 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:16:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a652e1c5-0b3e-406c-8015-91b17a82354f req-ba8c23b5-7f89-4af9-8f5c-4151809a1c13 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.200570 Nov 28 20:16:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 121/362] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "name": "network-vif-deleted", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] Creating event network-vif-deleted:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:16:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-eb48b261-f0e3-4daa-84ad-93b66064df04 req-982e9802-cd61-45e3-8bb7-94233abeeebb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167925 Nov 28 20:16:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 123/363] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cdf5581-3412-46dc-a702-30f759bf2b05", "name": "network-vif-plugged", "status": "completed", "tag": "dabcf8a5-911a-4edb-a993-c3cbfd06d4a9"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Creating event network-vif-plugged:dabcf8a5-911a-4edb-a993-c3cbfd06d4a9 for instance 4cdf5581-3412-46dc-a702-30f759bf2b05 on user Nov 28 20:16:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:16:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:16:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-66af1962-77ee-4a3d-9dc5-0ccb618f618d req-ee0d8ac1-7a42-4915-a311-35bdc97bd85b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.038116 Nov 28 20:16:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 120/364] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:22 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ddbc51e4-cf5a-4beb-a237-4fa01f3d0b9c tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1542 microversion: 2.1 time: 0.394941 Nov 28 20:16:22 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 122/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:22 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1542 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:16:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-df3dd1d1-60c9-494b-8c6f-cc25851d84fa req-6cc368c2-ca6a-4812-babc-cdf442580a43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048589 Nov 28 20:16:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 124/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:16:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:29 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:16:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0da37f67-ca79-4226-b537-cb7d644b9f39 req-dba4eb86-fa65-4a3f-a248-6e59ae74ed76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056291 Nov 28 20:16:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 121/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3c2a809c-666f-449b-a68e-46e7b1126ef1 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.570271 Nov 28 20:16:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 123/368] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:16:32 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8/os-interface => generated 1829 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:16:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] Creating event network-changed:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-8fec5d25-1a9e-4d86-a33d-96d916daff28 req-4b3a7794-01c6-46b0-ba12-ba781a4f7232 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068449 Nov 28 20:16:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 125/369] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-594759002", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:34 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] validate_networks() for [('60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9642030a-a2a2-4dc2-b726-ca18242d3055 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 200 len: 2826 microversion: 2.42 time: 1.267417 Nov 28 20:16:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 122/370] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:16:34 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 2826 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for user 007af37c9a914cd5863e486c041701be and project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:16:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:16:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-85417622-cc7d-4e2d-aa26-1243f4184fc8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.014989 Nov 28 20:16:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 124/371] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:16:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8d1f42a7-eeda-4b21-85e9-d29f3773aca5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 200 len: 1394 microversion: 2.87 time: 0.129556 Nov 28 20:16:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 123/372] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:16:35 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 1394 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:16:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e83c1870-1b82-4a08-ac7a-6da086de66b2 tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8/os-interface" status: 200 len: 1829 microversion: 2.42 time: 0.418930 Nov 28 20:16:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 126/373] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:16:35 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8/os-interface => generated 1829 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:16:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b91423d7-b93c-48a3-a8e0-fff42bca617e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: .version_select at 0x7f9e646fb400>, body: {"keypair": {"name": "tempest-keypair-526921959", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhZkQDdLZeWcw+DLJgWEP7/QLMXDWRzm0CPVYVn2k4jy1vGUzXjooGrXig9p8ufo5hQjxqLQZi7n2kxD83VZKSlK30YLJPXw2/ETdSXJesP9+5Qq2fcU4CsAGjcrk0PAw=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:36 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b91423d7-b93c-48a3-a8e0-fff42bca617e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for project 548f7955f73e434cb014eeaeffa2824f. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:16:36 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b91423d7-b93c-48a3-a8e0-fff42bca617e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for user 740070b2e6434ca9a733cb932663572c and project 548f7955f73e434cb014eeaeffa2824f. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:16:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b91423d7-b93c-48a3-a8e0-fff42bca617e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064299 Nov 28 20:16:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 125/374] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:16:36 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:16:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-852530d1-e328-4e72-89a6-a5f5848aff0b tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 204 len: 0 microversion: 2.42 time: 0.197067 Nov 28 20:16:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 124/375] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:16:37 2023] DELETE /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd826645c8f4f4ce7bb0cf606d9005ed2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '573c587fe3af43a5a01c4e5db0643075', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ae7f0987-9ac5-481b-a68d-6fa7aa75d09d tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 200 len: 2951 microversion: 2.42 time: 0.723016 Nov 28 20:16:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 127/376] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:16:37 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 2951 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:16:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "2eb26bff-1c84-413b-b3b4-fbc18940f912"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1646342622", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "80eb1442-8e05-4d31-96b5-26df5f47f887"}], "security_groups": [{"name": "tempest-securitygroup--1327198542"}], "key_name": "tempest-keypair-526921959", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] Creating event network-vif-unplugged:2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-64fc0160-03bf-47b6-a3e2-d6e59fa080b2 req-ab4c171d-6e3a-49d6-a972-4223617d8f54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069563 Nov 28 20:16:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 125/377] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:39 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] validate_networks() for [('80eb1442-8e05-4d31-96b5-26df5f47f887', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:16:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] Creating event network-vif-unplugged:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-28ded1a3-df2a-490c-b52f-b5e1a769f09f req-db526f78-c484-4ea9-b9bb-e6e3d0574bd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.334625 Nov 28 20:16:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 126/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] Creating event network-changed:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:16:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0d38f010-818d-4be8-8489-f7940fa7f65b req-f6e5dd29-e997-46c2-9a6b-9c604e76888c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041805 Nov 28 20:16:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for project 548f7955f73e434cb014eeaeffa2824f. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for user 740070b2e6434ca9a733cb932663572c and project 548f7955f73e434cb014eeaeffa2824f. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:16:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:16:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-97bf3800-6dcb-44a0-bc9c-98a41a790daa tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.483974 Nov 28 20:16:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 128/380] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:16:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 1488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:16:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d721ff08-55da-4312-aca2-6f3979927b6a tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d721ff08-55da-4312-aca2-6f3979927b6a tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:40 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-d721ff08-55da-4312-aca2-6f3979927b6a tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d721ff08-55da-4312-aca2-6f3979927b6a tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b" status: 200 len: 1234 microversion: 2.1 time: 0.083111 Nov 28 20:16:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 127/381] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:40 2023] GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b => generated 1234 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:16:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "2eb26bff-1c84-413b-b3b4-fbc18940f912"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] Creating event network-vif-plugged:2eb26bff-1c84-413b-b3b4-fbc18940f912 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-6a539c52-5acd-4b03-bd56-8c08f59c71fd req-12a202d0-6f51-4a83-ade2-45d4bd2285db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056479 Nov 28 20:16:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 127/382] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "13d2eb0a-77c7-4db6-96c1-547dc7781057"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "13d2eb0a-77c7-4db6-96c1-547dc7781057"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Creating event network-vif-plugged:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Creating event network-vif-unplugged:13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Creating event network-vif-plugged:13d2eb0a-77c7-4db6-96c1-547dc7781057 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Creating event network-vif-unplugged:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] Creating event network-vif-plugged:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e3765dd0-4b2d-468d-a726-40ee15201ff5 req-6633ae03-c45a-4646-a15b-51eda501418f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.036945 Nov 28 20:16:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 129/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-unplugged", "status": "completed", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Creating event network-vif-unplugged:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Creating event network-vif-plugged:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Creating event network-vif-unplugged:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Creating event network-vif-plugged:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] Creating event network-vif-unplugged:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-60283803-fb9d-4db5-9982-07cba15f731b req-61a570b0-1584-47bc-9c13-4ddb6691ef62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 873 microversion: 2.1 time: 0.046407 Nov 28 20:16:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 128/384] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 873 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:43 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "name": "network-vif-plugged", "status": "completed", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}, {"server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "name": "network-vif-plugged", "status": "completed", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Creating event network-vif-plugged:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:16:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] Creating event network-vif-plugged:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:16:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-020f76f2-5669-4ee7-8af7-b4735aff7acb req-d1ae491c-e378-4b86-869b-c021764f8e57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.051689 Nov 28 20:16:43 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 128/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-plugged", "status": "completed", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] Creating event network-vif-plugged:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-8b0c1a95-dcc4-45d4-b3c4-c55599d53989 req-e163ef92-a7b5-48f0-8948-5cfb4dfe88e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049958 Nov 28 20:16:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 130/386] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:16:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-deleted", "tag": "90cdd786-4498-4e1d-8eff-7407674beb52"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] Creating event network-vif-deleted:90cdd786-4498-4e1d-8eff-7407674beb52 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e66c6625-f7cf-4f81-a062-c5a56e915e8e req-1ea72418-130d-4bd1-9682-2b33af6b424a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060356 Nov 28 20:16:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 129/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] Creating event network-changed:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:16:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-b40fa814-5ecb-464e-900a-a2012e5bff29 req-e29b1026-72b3-4f91-9763-725505242334 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047190 Nov 28 20:16:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 129/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-deleted", "tag": "00fac4f4-969a-449b-a264-4d1ce345c3b6"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-deleted", "tag": "78aeb66d-2196-43e4-80fb-ffbf4559d29f"}, {"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-deleted", "tag": "dec8aa66-f6b6-4e5a-b055-c6321063f024"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Creating event network-vif-deleted:00fac4f4-969a-449b-a264-4d1ce345c3b6 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Creating event network-vif-deleted:78aeb66d-2196-43e4-80fb-ffbf4559d29f for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] Creating event network-vif-deleted:dec8aa66-f6b6-4e5a-b055-c6321063f024 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-32ec4c06-c3a9-4c7f-b837-84240735bde6 req-2cf43eb3-c992-456b-b0ee-931fad541478 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.050541 Nov 28 20:16:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 131/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:46 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:47 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "name": "network-vif-plugged", "status": "completed", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}, {"server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "name": "network-vif-plugged", "status": "completed", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Creating event network-vif-plugged:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:16:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] Creating event network-vif-plugged:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:16:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1a79df9a-81cd-4a79-9492-248c1458a651 req-f7cab6ea-1217-4904-a954-3f4476e5466e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.087927 Nov 28 20:16:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 130/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:16:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17cffd89-efcd-4c35-8c12-75393c8776f8", "name": "network-vif-deleted", "tag": "5923f2c1-af01-4178-8faf-143583adb2d9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:16:48 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] Creating event network-vif-deleted:5923f2c1-af01-4178-8faf-143583adb2d9 for instance 17cffd89-efcd-4c35-8c12-75393c8776f8 on user Nov 28 20:16:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-10bb8108-74e8-49d3-ae38-3e21eb7479d4 req-50cbd342-1151-448d-8d34-b2adfe7be922 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Nov 28 20:16:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 130/391] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:16:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:16:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:16:57 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:16:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-913ae79e-288f-4f5f-b72e-0383c3149c40 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1724 microversion: 2.1 time: 0.260716 Nov 28 20:16:57 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 132/392] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:16:56 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:00 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3805f11e-821b-49a8-9a93-ac85968aca4b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 200 len: 1534 microversion: 2.1 time: 0.261151 Nov 28 20:17:00 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 131/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:00 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 1534 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-13ee5589-8b5c-4ab4-b960-864be41d4a27 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.159910 Nov 28 20:17:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 131/394] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:17:06 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface => generated 282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: 4cdf5581-3412-46dc-a702-30f759bf2b05] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] HTTP exception thrown: Instance 4cdf5581-3412-46dc-a702-30f759bf2b05 could not be found. Nov 28 20:17:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Returning 404 to user: Instance 4cdf5581-3412-46dc-a702-30f759bf2b05 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:17:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-60a26c06-934a-47cc-bc55-e2783b8bee68 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05" status: 404 len: 111 microversion: 2.1 time: 0.033064 Nov 28 20:17:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 133/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:07 2023] GET /compute/v2.1/servers/4cdf5581-3412-46dc-a702-30f759bf2b05 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:17:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] Creating event network-changed:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-d210b06e-cae9-4c32-993d-431fd86015ac req-a4e5937e-f5e3-49e1-aff3-69858faf0f35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 Nov 28 20:17:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 132/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:08 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8a63390e-a5c2-4e77-beda-340e59a548b2 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 200 len: 1625 microversion: 2.49 time: 0.158974 Nov 28 20:17:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 132/397] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:17:08 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 1625 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "32177d6d-e6ed-4260-8a2e-c3fd0c3fd205", "tag": "nic-tag"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] Creating event network-changed:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a304c1cf-eb3a-43b7-816c-1caaff781c26 req-5e62b55f-e6b7-4270-91dc-4907ab3b1af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043492 Nov 28 20:17:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 133/398] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:11 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:17:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a0575ab0-662f-4020-9aed-944032547813 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2" status: 204 len: 0 microversion: 2.1 time: 0.193516 Nov 28 20:17:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 133/399] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:17:11 2023] DELETE /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:11 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d747c1fd611452f8d0e6ee1b423cd2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63ff2e349b40430a91730a22fd4a0487', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0f691d88-ba6a-41f7-8831-d84d74a8de6b tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2" status: 200 len: 1668 microversion: 2.1 time: 0.381935 Nov 28 20:17:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:11 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2 => generated 1668 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-5d595423-24fb-4b47-99e3-8c6493a9296e tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.724229 Nov 28 20:17:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 134/401] 10.0.0.210 () {66 vars in 1414 bytes} [Tue Nov 28 20:17:08 2023] POST /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface => generated 283 bytes in 3727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d85e3eb6-33c9-4c3f-9931-9d3884bc59ce", "tag": "volume-tag"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}, {"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}, {"server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "name": "network-vif-unplugged", "status": "completed", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Creating event network-vif-plugged:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Creating event network-vif-plugged:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] Creating event network-vif-unplugged:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:17:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e60d1edb-f457-4f5e-81bd-f6b7fd9a41c8 req-b6496f97-fee1-452d-a704-c8487943ea05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.038208 Nov 28 20:17:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:12 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-117f79c8-fbe6-4294-9bf8-c3e1f8fb70d0 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.350464 Nov 28 20:17:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 134/403] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 20:17:12 2023] POST /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:17:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "name": "network-vif-plugged", "status": "completed", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}, {"server_uuid": "fe726611-331a-495f-a6bd-ced2d1a305b2", "name": "network-vif-deleted", "tag": "4ccfe8e6-0fe8-4546-8469-9c0634eaf74c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Creating event network-vif-plugged:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:17:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] Creating event network-vif-deleted:4ccfe8e6-0fe8-4546-8469-9c0634eaf74c for instance fe726611-331a-495f-a6bd-ced2d1a305b2 on user Nov 28 20:17:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d37654d9-62f0-49fa-b3a0-9c4b1bb95ec2 req-bd7e29b8-2f8b-49ab-906f-f8c8789be2a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032552 Nov 28 20:17:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 135/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:17:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3ac5197a-a632-416b-be0e-99a85db98195 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823" status: 204 len: 0 microversion: 2.1 time: 0.150726 Nov 28 20:17:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 136/405] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:17:17 2023] DELETE /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e01c9d8d644299bbf6b9a18e00fcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bed5b9f19e584ca5bd8bf2d75b5ee765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d5df652a-0f71-461c-8a7d-c7233c664403 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823" status: 200 len: 1490 microversion: 2.1 time: 0.248681 Nov 28 20:17:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 135/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:17 2023] GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823 => generated 1490 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "name": "network-vif-unplugged", "status": "completed", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] Creating event network-vif-unplugged:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:17:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3ed22b19-f239-4a47-b243-3e1a60f89e47 req-d7f90ca2-e891-4c71-9110-cbfe3f787d83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032412 Nov 28 20:17:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "name": "network-vif-deleted", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] Creating event network-vif-deleted:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:17:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-9fa1825a-18f8-4242-b4c7-10ef25ceb2f2 req-07abcfe2-ba75-49ce-aaca-0acf9d20e729 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063017 Nov 28 20:17:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 137/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e05b0276-16f8-4876-b37b-711b63d65823", "name": "network-vif-plugged", "status": "completed", "tag": "3f17c541-af4d-4b2a-97c2-ede6623f7609"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] Creating event network-vif-plugged:3f17c541-af4d-4b2a-97c2-ede6623f7609 for instance e05b0276-16f8-4876-b37b-711b63d65823 on user Nov 28 20:17:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-9bdcc25e-6531-4cd2-967e-9014f8619868 req-5b595356-0201-4d20-b656-4da10de304bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032257 Nov 28 20:17:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 136/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:22 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6af244b4-17bc-41a5-8ab7-5f073608136b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171008 Nov 28 20:17:22 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 137/410] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:17:22 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] Creating event network-changed:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:17:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e9fe5eee-d10b-4eec-8e1e-2b235ec6b262 req-b9493e8e-1515-4e61-a6d9-31caefd02a68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043679 Nov 28 20:17:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 138/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:24 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:24 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c334ca67-c1fe-4d96-9c78-7e507b274d20 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1542 microversion: 2.1 time: 0.368454 Nov 28 20:17:24 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 137/412] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:23 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1542 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:24 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lazy-loading 'services' on Instance uuid f6e9eab9-0445-4dcd-bd67-ef73e102c909 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-187e47f0-7eb8-43eb-9a84-73657a6c1d04 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments/d85e3eb6-33c9-4c3f-9931-9d3884bc59ce" status: 202 len: 0 microversion: 2.49 time: 0.183800 Nov 28 20:17:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 138/413] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 20:17:24 2023] DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments/d85e3eb6-33c9-4c3f-9931-9d3884bc59ce => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:17:24 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-697b7c6e-efce-4859-a765-b2df182a8497 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1542 microversion: 2.1 time: 0.209061 Nov 28 20:17:24 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 139/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:24 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1542 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-42719cd1-8d58-4407-aec5-4a9217dd1746 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 200 len: 1690 microversion: 2.87 time: 0.202578 Nov 28 20:17:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 138/415] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:17:25 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 1690 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HTTP exception thrown: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. Nov 28 20:17:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Returning 404 to user: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:17:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-eedba4be-b5a0-474a-b9c4-15ca199454ac tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 404 len: 111 microversion: 2.42 time: 0.032854 Nov 28 20:17:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 139/416] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:17:28 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:17:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-674f7ae8-c2b0-4bed-911a-be92d2a56a4c tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '.version_select at 0x7f9e646f9630>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-674f7ae8-c2b0-4bed-911a-be92d2a56a4c tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759875013" status: 204 len: 0 microversion: 2.42 time: 0.024140 Nov 28 20:17:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 140/417] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 20:17:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1759875013 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:30 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bd64ab85-87f2-4415-aa83-a67404afc7d8 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b" status: 200 len: 1541 microversion: 2.1 time: 0.476506 Nov 28 20:17:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 139/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:30 2023] GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b => generated 1541 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HTTP exception thrown: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. Nov 28 20:17:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Returning 404 to user: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:17:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-459a30f0-4114-4266-96b7-69e08f39eddd tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 404 len: 111 microversion: 2.42 time: 0.036337 Nov 28 20:17:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 140/419] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:17:32 2023] DELETE /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] [instance: 17cffd89-efcd-4c35-8c12-75393c8776f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] HTTP exception thrown: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. Nov 28 20:17:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] Returning 404 to user: Instance 17cffd89-efcd-4c35-8c12-75393c8776f8 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:17:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3dec69b7-be68-459d-a7cc-3113dbea826f tempest-TaggedBootDevicesTest_v242-771180377 tempest-TaggedBootDevicesTest_v242-771180377-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8" status: 404 len: 111 microversion: 2.42 time: 0.042881 Nov 28 20:17:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 141/420] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:17:32 2023] GET /compute/v2.1/servers/17cffd89-efcd-4c35-8c12-75393c8776f8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-155565e0-6ee8-4870-999b-47a7f84c3ec9 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface/91f1f715-9419-4a1e-a8d2-c14353edb662" status: 202 len: 0 microversion: 2.49 time: 0.062334 Nov 28 20:17:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 140/421] 10.0.0.210 () {64 vars in 1507 bytes} [Tue Nov 28 20:17:46 2023] DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-interface/91f1f715-9419-4a1e-a8d2-c14353edb662 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d289a300-1587-4c72-9fdd-26ab22733097 tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9" status: 200 len: 474 microversion: 2.49 time: 0.222468 Nov 28 20:17:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 141/422] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 20:17:47 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9 => generated 474 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-unplugged", "status": "completed", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] Creating event network-vif-unplugged:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-f74f3c95-68b7-4e2a-b2d4-da5f0d958f70 req-7d67dff4-fda5-481f-94aa-c040982d048c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073781 Nov 28 20:17:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 142/423] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:17:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] Creating event network-vif-plugged:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:17:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-df6b63d1-47b1-4c48-aee7-ae87695267b3 req-7ed216c6-6e61-4ea1-8eb3-31aa02924285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028273 Nov 28 20:17:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 141/424] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:57 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0a371491-c560-4235-b134-42de59726f5a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1724 microversion: 2.1 time: 0.370561 Nov 28 20:17:57 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 142/425] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:57 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:17:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:17:58 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:17:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0352d672-c6aa-448a-a39f-683d3928c196 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.242898 Nov 28 20:17:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 143/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:17:57 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=7,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:01 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a5308be3-eade-4003-aee5-2aba3cb82705 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 200 len: 1534 microversion: 2.1 time: 0.717846 Nov 28 20:18:01 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 142/427] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:00 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 1534 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] [instance: fe726611-331a-495f-a6bd-ced2d1a305b2] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] HTTP exception thrown: Instance fe726611-331a-495f-a6bd-ced2d1a305b2 could not be found. Nov 28 20:18:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Returning 404 to user: Instance fe726611-331a-495f-a6bd-ced2d1a305b2 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:18:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ed475164-25cb-468b-8561-9d4c2e601c4e tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2" status: 404 len: 111 microversion: 2.1 time: 0.037975 Nov 28 20:18:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:01 2023] GET /compute/v2.1/servers/fe726611-331a-495f-a6bd-ced2d1a305b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:18:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8025128c-f5e7-4683-a6e4-0c56a7050960 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] Calling method '.version_select at 0x7f9e646f9d80>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8025128c-f5e7-4683-a6e4-0c56a7050960 tempest-VolumesAdminNegativeTest-1106730846 tempest-VolumesAdminNegativeTest-1106730846-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745238648" status: 202 len: 0 microversion: 2.1 time: 0.029428 Nov 28 20:18:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 144/429] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:18:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745238648 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:18:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a7c4f354-9c97-419e-991a-8511fd408899 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'create', calling method: .version_select at 0x7f9e64310280>, body: {"keypair": {"name": "tempest-keypair-794763884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYTiwvlcWoEsangDB2AZ9sHLwb27V6zeNEeQyWpqOj3c4cWFR+pVY0iquLeDfKp7vix8Thyhov7xyHfY/9+bwp0ql4HQc4hqo4O1gIedyQ6vayMqqQvIV8W2owXgQYlrg=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:02 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-a7c4f354-9c97-419e-991a-8511fd408899 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting quotas for project 7077abda0e884a0883f39e48e56af27e. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:18:02 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-a7c4f354-9c97-419e-991a-8511fd408899 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting quotas for user 4045806241134f5580140b5049e33228 and project 7077abda0e884a0883f39e48e56af27e. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:18:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a7c4f354-9c97-419e-991a-8511fd408899 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.064146 Nov 28 20:18:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 143/430] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:18:02 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:02 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] Creating event network-changed:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:18:02 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e03f32d1-3606-4142-bf69-c1d4ffee096b req-007e2cd6-358f-49b3-b333-935e8ea8aa06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043816 Nov 28 20:18:02 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b945a610-a97e-4a4d-8631-3100a3a3101b"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-444e10d3-811e-4564-836f-b5a238aed211 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "POST /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.394315 Nov 28 20:18:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 145/432] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:18:04 2023] POST /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments => generated 194 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1017855203", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "afa47bc5-6f66-41d1-9a82-74060d2f10c4"}], "security_groups": [{"name": "tempest-securitygroup--76118258"}], "key_name": "tempest-keypair-794763884", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:05 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] validate_networks() for [('afa47bc5-6f66-41d1-9a82-74060d2f10c4', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting quotas for project 7077abda0e884a0883f39e48e56af27e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Getting quotas for user 4045806241134f5580140b5049e33228 and project 7077abda0e884a0883f39e48e56af27e. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:18:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:18:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bbf69764-e402-451e-a9f7-a9662a2c60ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.697759 Nov 28 20:18:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 144/433] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:18:05 2023] POST /compute/v2.1/servers => generated 402 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:18:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e4f772d2-5f3c-4475-b7fe-5d77e83ec055 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e4f772d2-5f3c-4475-b7fe-5d77e83ec055 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:06 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-e4f772d2-5f3c-4475-b7fe-5d77e83ec055 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e4f772d2-5f3c-4475-b7fe-5d77e83ec055 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1237 microversion: 2.1 time: 0.064420 Nov 28 20:18:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:06 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-deleted", "tag": "91f1f715-9419-4a1e-a8d2-c14353edb662"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] Creating event network-vif-deleted:91f1f715-9419-4a1e-a8d2-c14353edb662 for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:18:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-999f09e0-aa7f-4b63-9a9c-bba71a416b34 req-91992982-a8fc-4b4f-b7b4-7776c3023d1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047396 Nov 28 20:18:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 145/435] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] [instance: e05b0276-16f8-4876-b37b-711b63d65823] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] HTTP exception thrown: Instance e05b0276-16f8-4876-b37b-711b63d65823 could not be found. Nov 28 20:18:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] Returning 404 to user: Instance e05b0276-16f8-4876-b37b-711b63d65823 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:18:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-935d2c9a-6ad8-4644-8dda-315668834ea6 tempest-VolumesActionsTest-1803837223 tempest-VolumesActionsTest-1803837223-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823" status: 404 len: 111 microversion: 2.1 time: 0.765857 Nov 28 20:18:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 146/436] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:08 2023] GET /compute/v2.1/servers/e05b0276-16f8-4876-b37b-711b63d65823 => generated 111 bytes in 767 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:18:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] Creating event network-changed:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:18:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7ef7aa8e-9382-4f3b-bbc1-9231be861d7b req-79d1498b-1665-427c-9604-7285e7178e3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Nov 28 20:18:09 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 146/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:18:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-5ed7ac10-bfb3-448c-9361-f8423c572a15 req-bfbf2536-1e37-47ed-a54d-868e3e30015f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052214 Nov 28 20:18:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 146/438] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:18:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e46491e2-0c15-412d-b570-b45095babed2 req-6bffa3eb-9721-4b19-bb53-51a79f535f1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034903 Nov 28 20:18:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 147/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:14 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-198baee6-39f2-4fb7-9227-587d6b79c880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1661 microversion: 2.1 time: 0.250786 Nov 28 20:18:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 147/440] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:14 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1661 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:15 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d46678e2-eb33-46f4-99e3-52d5d7150847 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1661 microversion: 2.1 time: 0.238849 Nov 28 20:18:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:14 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1661 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:16 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lazy-loading 'services' on Instance uuid 785632ec-4b56-4fca-82a5-67e3d52de9cb {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:18:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7b5c5105-1428-4315-962c-e93855208636 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments/b945a610-a97e-4a4d-8631-3100a3a3101b" status: 202 len: 0 microversion: 2.1 time: 0.250111 Nov 28 20:18:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 148/442] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:18:16 2023] DELETE /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments/b945a610-a97e-4a4d-8631-3100a3a3101b => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d02d88c3-1694-4486-a055-f6a4d18af616 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050151 Nov 28 20:18:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 148/443] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:18:16 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1143985493"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=18 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6908c2d0-37e9-4854-bc9f-031dd269dc67 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/action" status: 202 len: 52 microversion: 2.87 time: 1.315293 Nov 28 20:18:27 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 148/444] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:18:26 2023] POST /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e/action => generated 52 bytes in 1318 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6f542ce4-c45e-4314-9294-4ee3e3ed31ca tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.434299 Nov 28 20:18:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 149/445] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:18:31 2023] GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-interface => generated 282 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=16 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=24 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] Creating event network-changed:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:18:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-200cd471-88cd-4643-ac88-8f53ab1ea156 req-d80ea81c-7267-46b7-8b12-256fc96cce29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121623 Nov 28 20:18:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 149/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ff37446-5abc-43b6-899c-41739cf0e669", "device": "/dev/vdb"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-cd2a6cc0-c308-409a-8cee-cdf0f51fded6 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845845 Nov 28 20:18:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 149/447] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:18:33 2023] POST /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-15c5d27c-a7a7-4a9a-b092-12f2fff7775f tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9" status: 200 len: 503 microversion: 2.49 time: 0.144907 Nov 28 20:18:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 150/448] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 20:18:37 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9 => generated 503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d6213786-cdac-4ce9-99a0-0ee3ba76e4af tempest-TaggedAttachmentsTest-474444744 tempest-TaggedAttachmentsTest-474444744-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9" status: 200 len: 503 microversion: 2.49 time: 0.083325 Nov 28 20:18:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 150/449] 10.0.0.210 () {64 vars in 1537 bytes} [Tue Nov 28 20:18:37 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-instance-actions/req-155565e0-6ee8-4870-999b-47a7f84c3ec9 => generated 503 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a06ae042-3ac7-46a2-9d8d-d9fe4902b4e8 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.056190 Nov 28 20:18:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 150/450] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 20:18:37 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:37 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-37e4a32c-f394-4fa3-80c4-21e1599cdfde tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 200 len: 1703 microversion: 2.87 time: 0.294590 Nov 28 20:18:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 151/451] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:18:38 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 1703 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:18:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7e7bddb8-5603-40d6-9fb1-5b3a83e5638c tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 204 len: 0 microversion: 2.49 time: 0.663557 Nov 28 20:18:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 151/452] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:18:37 2023] DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-unplugged", "status": "completed", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:39 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:39 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:39 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3de9c75fa13b4cfdaa348ed6e28e9d97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82eb04f7bcf944c58f07769918fb18ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1ba6a4ae-93e0-4323-bb2a-241e119abd54 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 200 len: 1749 microversion: 2.49 time: 1.160892 Nov 28 20:18:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 151/453] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:18:38 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 1749 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:18:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] Creating event network-vif-unplugged:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:18:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-a7a54322-8df5-4c96-8acb-72c4be1d94ab req-7e3dfafa-9b3c-409c-b041-4dd17586864e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129867 Nov 28 20:18:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 152/454] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-plugged", "status": "completed", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] Creating event network-vif-plugged:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:18:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-45e9ffe9-05c1-4fd3-98a4-a6e2c31b6879 req-53066024-6424-4b0f-b681-abb983b7ab73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033181 Nov 28 20:18:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 152/455] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e9eab9-0445-4dcd-bd67-ef73e102c909", "name": "network-vif-deleted", "tag": "cce19286-ec4f-4349-94c7-67f6ab63551c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] Creating event network-vif-deleted:cce19286-ec4f-4349-94c7-67f6ab63551c for instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 on user Nov 28 20:18:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f5681f04-2e3e-4978-910a-2bc3752988bd req-5dea14ad-5bdb-4802-9799-83a6ff45f707 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037514 Nov 28 20:18:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 152/456] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1d10660f-1b50-4f12-b4d9-2baf657db737 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Action: 'create', calling method: .version_select at 0x7f9e6449aef0>, body: {"keypair": {"name": "tempest-keypair-1886893260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJ6RJZRcy13eAf7NmGsUkRNJRh5VIZeh8ZBoDKubWzN8NQek5ymgNNtZ9BZ6I9MPo0LHKuylDgwk+TEMe1LEwks8Mm7vn/i95Rvj5pF5RMn2DpzEwA71rc1zhpzQCbWGw=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:45 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-1d10660f-1b50-4f12-b4d9-2baf657db737 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting quotas for project f0b00222407b41f99d3b983afaeb6c5a. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:18:45 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-1d10660f-1b50-4f12-b4d9-2baf657db737 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting quotas for user dcac1e80fd41480b9250746018d93e2c and project f0b00222407b41f99d3b983afaeb6c5a. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:18:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1d10660f-1b50-4f12-b4d9-2baf657db737 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064850 Nov 28 20:18:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 153/457] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:18:45 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachmentScenario-server-980991755", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "0ea81c46-dc4e-497a-98de-313521fac370"}], "security_groups": [{"name": "tempest-securitygroup--1924036328"}], "key_name": "tempest-keypair-1886893260", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] validate_networks() for [('0ea81c46-dc4e-497a-98de-313521fac370', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting quotas for project f0b00222407b41f99d3b983afaeb6c5a. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Getting quotas for user dcac1e80fd41480b9250746018d93e2c and project f0b00222407b41f99d3b983afaeb6c5a. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:18:47 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:18:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4c3957dd-cdda-46e6-9748-7fd856854937 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.763027 Nov 28 20:18:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 153/458] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:18:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:18:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-13104afb-7c20-4def-ac40-7d70ca6e8f7a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:47 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-13104afb-7c20-4def-ac40-7d70ca6e8f7a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:47 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-13104afb-7c20-4def-ac40-7d70ca6e8f7a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-13104afb-7c20-4def-ac40-7d70ca6e8f7a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 200 len: 1243 microversion: 2.1 time: 0.096787 Nov 28 20:18:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 153/459] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:47 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 1243 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:50 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:50 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] Creating event network-changed:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:18:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5cf2d01a-0c21-4fa2-a295-d647e5b3b8f5 req-b12b91cb-ced8-4c81-a506-8e2422d34cfb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 Nov 28 20:18:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 154/460] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "name": "network-vif-plugged", "status": "completed", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] Creating event network-vif-plugged:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:18:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-6ee9c2b8-81c1-4b15-b61a-35ce20c2d539 req-7f324deb-fb2c-4c9f-b76a-92e8477f193b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055699 Nov 28 20:18:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 154/461] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "name": "network-vif-plugged", "status": "completed", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:18:55 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] Creating event network-vif-plugged:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:18:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-872ce432-3fba-4a3e-b4d6-448ea97b1232 req-3d19c7cf-398e-431f-86aa-e007224936df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042511 Nov 28 20:18:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 154/462] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:18:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:56 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:18:56 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-903f66dd-6988-432e-a0ad-1fd075c2127e tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1548 microversion: 2.1 time: 0.264557 Nov 28 20:18:56 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 155/463] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:18:56 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1548 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:58 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lazy-loading 'services' on Instance uuid b4000485-c53c-46e7-b585-cec40c114ec9 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:18:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a8bccb1f-1a82-4ed0-b86f-344ee04b7373 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments/be8885e7-c3ff-4344-ba63-87e0e83cf851" status: 202 len: 0 microversion: 2.1 time: 0.292216 Nov 28 20:18:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 155/464] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:18:58 2023] DELETE /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments/be8885e7-c3ff-4344-ba63-87e0e83cf851 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:18:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:18:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4c5b51f5-2c0e-47a3-8dec-2eae83844c77 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066192 Nov 28 20:18:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 155/465] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:18:58 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'services' on Instance uuid fc91159a-f3ce-4674-b9e4-a548d373471b {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:19:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c84ba884-abb2-409c-a9fa-e06efa8ffbf0 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-volume_attachments/3ff37446-5abc-43b6-899c-41739cf0e669" status: 202 len: 0 microversion: 2.1 time: 0.286766 Nov 28 20:19:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 156/466] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:19:06 2023] DELETE /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b/os-volume_attachments/3ff37446-5abc-43b6-899c-41739cf0e669 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:19:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-03be7b34-461b-4b52-8c2b-e02d649d19a5 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b" status: 204 len: 0 microversion: 2.1 time: 0.175315 Nov 28 20:19:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 156/467] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:19:06 2023] DELETE /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7522d32e-5fc6-4ff5-967b-87bab9174364 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074240 Nov 28 20:19:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 157/468] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:19:06 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:19:07 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-cfb5602d-d56b-4937-ae99-0e991db4e72e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b" status: 200 len: 1712 microversion: 2.1 time: 0.341441 Nov 28 20:19:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 156/469] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:06 2023] GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b => generated 1712 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d3034786-d356-4293-bee9-d4faaa1c1bee tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: .version_select at 0x7f9e6456f0a0>, body: {"keypair": {"name": "tempest-keypair-2062785846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGh0OvPNUnw0HlK5G584yN+gpnf86YMaudmoj1ZhKVFwAinhV6vAO9CJeiE48YExnyL1P7BzKCVI1GwObgP7Q4v0iy8rjQmkoZJJgf8xiwgR6GgkTRhAfEFVt2LCndxirA=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:07 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-d3034786-d356-4293-bee9-d4faaa1c1bee tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting quotas for project ee4056e8f34a4e8da54592d28d7a75a1. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:07 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-d3034786-d356-4293-bee9-d4faaa1c1bee tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting quotas for user 270de3ab19964431afa20c767af7b23c and project ee4056e8f34a4e8da54592d28d7a75a1. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d3034786-d356-4293-bee9-d4faaa1c1bee tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209198 Nov 28 20:19:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 157/470] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:19:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] Creating event network-changed:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-40f05e36-2c55-4b21-bed0-00c08dd7e85c req-c830906c-e3ca-4a77-87d8-9faf3b09f1af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034979 Nov 28 20:19:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:19:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 157/471] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e49a5f49-cdd8-4709-933a-c73e947f86f7 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 204 len: 0 microversion: 2.1 time: 0.135504 Nov 28 20:19:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 158/472] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:19:07 2023] DELETE /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:08 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8c713fb6-7d1a-44ef-a597-f407b074d8a8 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 200 len: 1659 microversion: 2.1 time: 0.365270 Nov 28 20:19:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 158/473] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:08 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 1659 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-deleted", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] Creating event network-vif-deleted:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-d7d3b77b-46b1-4e19-9fcb-182d7bf0dd50 req-43c59821-b3a2-4cff-b8b2-de1fa6571a6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037807 Nov 28 20:19:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 158/474] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-unplugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-unplugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}, {"server_uuid": "785632ec-4b56-4fca-82a5-67e3d52de9cb", "name": "network-vif-plugged", "status": "completed", "tag": "68b6901f-6f94-4e02-af4c-d45b8f67fbea"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-unplugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-unplugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] Creating event network-vif-plugged:68b6901f-6f94-4e02-af4c-d45b8f67fbea for instance 785632ec-4b56-4fca-82a5-67e3d52de9cb on user Nov 28 20:19:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-c85fac29-5c77-4637-a4bc-a3d320cf3d59 req-772f8055-14d5-4c5d-83d0-0a43bdf59ba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.034294 Nov 28 20:19:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 159/475] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:11 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1119065400", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "key_name": "tempest-keypair-2062785846", "security_groups": [{"name": "tempest-secgroup-smoke-259596839"}, {"name": "tempest-securitygroup--46887214"}], "networks": [{"uuid": "ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:11 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] validate_networks() for [('ea6311e0-5049-4a8d-a0e1-b3d7c5ae6f52', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting quotas for project ee4056e8f34a4e8da54592d28d7a75a1. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Getting quotas for user 270de3ab19964431afa20c767af7b23c and project ee4056e8f34a4e8da54592d28d7a75a1. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:19:12 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:19:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-86b02185-1fd6-4ac4-a49a-0d9ff28592f7 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 448 microversion: 2.1 time: 0.587207 Nov 28 20:19:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 159/476] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:19:11 2023] POST /compute/v2.1/servers => generated 448 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:19:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e8e35da4-b76b-4f61-9541-e897bfca5c0c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:12 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e8e35da4-b76b-4f61-9541-e897bfca5c0c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:12 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e8e35da4-b76b-4f61-9541-e897bfca5c0c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270de3ab19964431afa20c767af7b23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4056e8f34a4e8da54592d28d7a75a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e8e35da4-b76b-4f61-9541-e897bfca5c0c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 200 len: 1236 microversion: 2.1 time: 0.070672 Nov 28 20:19:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 159/477] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:12 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] Creating event network-changed:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:19:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6654f517-d4c4-4d1c-b61b-e427e7f34b34 req-6e4202b0-bd04-4dc8-9c18-d4b6054f6508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043702 Nov 28 20:19:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 160/478] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "name": "network-vif-plugged", "status": "completed", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] Creating event network-vif-plugged:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:19:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1f9eea4f-c882-4ef1-85c6-9e9d3c38a47f req-5130f61d-0630-4e16-abfe-9d314d4cb6d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042134 Nov 28 20:19:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 160/479] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a86d293a-3ee2-4437-8e9d-3456c496754a tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1661 microversion: 2.1 time: 0.193768 Nov 28 20:19:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 160/480] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:17 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1661 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78f18bcc-3456-4d6b-a070-51c3de9d32ec"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7273c998-70d6-4a49-a356-ede581737913 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274654 Nov 28 20:19:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 161/481] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:19:17 2023] POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "name": "network-vif-plugged", "status": "completed", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] Creating event network-vif-plugged:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:19:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-16808692-2ffb-4c4d-952e-683b236bd6c4 req-f37d82e4-b3da-4539-8129-5fe4c84c9def service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 Nov 28 20:19:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 161/482] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=30 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=24 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Old instance type m1.tiny, new instance type m1.small {{(pid=65586) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for project 8895df748b4644e9bad362ea318e04c7. Resources: {'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Getting quotas for user 0ffae0c69e0c40e0917cf412e7757616 and project 8895df748b4644e9bad362ea318e04c7. Resources: {'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:19:28 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "name": "network-vif-unplugged", "status": "completed", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] Creating event network-vif-unplugged:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:19:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1031ea79-b941-4c23-873e-61c9e94f76e4 req-c5f09a98-2d75-45d6-8dd8-7dd472acafd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037497 Nov 28 20:19:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 162/483] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-67e84d0f-5167-429e-ac72-57cc98308c00 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/action" status: 202 len: 0 microversion: 2.1 time: 0.420578 Nov 28 20:19:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 161/484] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:19:28 2023] POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:28 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bdc33676-7172-464e-a16d-47af216d2787 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 200 len: 1690 microversion: 2.87 time: 0.269633 Nov 28 20:19:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 162/485] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:19:28 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 1690 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:19:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3949e214-bb06-43c1-97d3-c85ad245f0f8 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1716 microversion: 2.1 time: 0.528149 Nov 28 20:19:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 163/486] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:28 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1716 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] HTTP exception thrown: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. Nov 28 20:19:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Returning 404 to user: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:19:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-41e6c98f-953f-47dd-b897-892b714436a3 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 404 len: 111 microversion: 2.49 time: 0.031263 Nov 28 20:19:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 162/487] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:19:29 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:19:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3c651a1c-29a6-4213-aa69-1eb84c3c6818 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '.version_select at 0x7f9e64499990>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3c651a1c-29a6-4213-aa69-1eb84c3c6818 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640947232" status: 204 len: 0 microversion: 2.49 time: 0.023331 Nov 28 20:19:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 163/488] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Nov 28 20:19:29 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1640947232 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:19:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "name": "network-vif-plugged", "status": "completed", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}, {"server_uuid": "fc91159a-f3ce-4674-b9e4-a548d373471b", "name": "network-vif-deleted", "tag": "d190a550-01ac-49d5-a9dc-b62ed711fe32"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Creating event network-vif-plugged:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:19:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] Creating event network-vif-deleted:d190a550-01ac-49d5-a9dc-b62ed711fe32 for instance fc91159a-f3ce-4674-b9e4-a548d373471b on user Nov 28 20:19:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e0b2a45f-4bc5-482d-82d6-7b41640f8dbc req-0a8d8bcd-4bfb-4d02-a80b-64fc0e6f40a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046278 Nov 28 20:19:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 164/489] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] HTTP exception thrown: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. Nov 28 20:19:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Returning 404 to user: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:19:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f61ece95-bee3-4a73-89d3-4f6f7a30f7d5 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 404 len: 111 microversion: 2.49 time: 0.333569 Nov 28 20:19:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 163/490] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:19:31 2023] DELETE /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 111 bytes in 335 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] [instance: f6e9eab9-0445-4dcd-bd67-ef73e102c909] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] HTTP exception thrown: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. Nov 28 20:19:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] Returning 404 to user: Instance f6e9eab9-0445-4dcd-bd67-ef73e102c909 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:19:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-58147f1e-f606-4463-9df8-3f243108dbf7 tempest-TaggedAttachmentsTest-1139944601 tempest-TaggedAttachmentsTest-1139944601-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909" status: 404 len: 111 microversion: 2.49 time: 0.047638 Nov 28 20:19:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 164/491] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:19:32 2023] GET /compute/v2.1/servers/f6e9eab9-0445-4dcd-bd67-ef73e102c909 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-unplugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Creating event network-vif-unplugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:19:32 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:19:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e9d2179c-6280-4207-957e-5fee37633673 req-aa99445e-8e5a-479a-a093-217419b3ab39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100670 Nov 28 20:19:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 165/492] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:19:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:19:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3a4f68c8-b9a6-43aa-ac4f-d850602afebd req-04c22317-c7ce-457d-bbc4-18e8ab5db1aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065972 Nov 28 20:19:34 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3e3d4be9-8047-4e3e-a6fa-1b33200f3574 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 200 len: 1564 microversion: 2.1 time: 0.240040 Nov 28 20:19:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 165/494] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:38 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 1564 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-17ed7da2-4489-4691-be6f-af04431460c5 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Action: 'create', calling method: .version_select at 0x7f9e6475fd00>, body: {"keypair": {"name": "tempest-TestShelveInstance-752726007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmRcrC+xEv9eq37KyVT3MN4g49xlT+tn2VHmIKI8IcmxomxVAiv7jCoA2CnKkM7knNVo8lhq5y0km1V+3OkdmA2AikbyaTLdfflHbz5DT3b54IbjGqVSR4M2T2o8iHZcQ=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-17ed7da2-4489-4691-be6f-af04431460c5 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting quotas for project 8bcf01c7a7d24806a2ffe82ec75c8a51. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-17ed7da2-4489-4691-be6f-af04431460c5 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting quotas for user ca4e178401f940438a766a048076af93 and project 8bcf01c7a7d24806a2ffe82ec75c8a51. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-17ed7da2-4489-4691-be6f-af04431460c5 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.256686 Nov 28 20:19:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 166/495] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:19:41 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=20 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:19:46 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:19:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-bdd30ce0-6c99-41df-939d-1f34c5f8b144 req-2cda9112-33b0-4c5f-91c1-eecbeacc4754 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085485 Nov 28 20:19:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 165/496] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=14 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a816ae6c-cb1b-4997-8396-65d23ce7957e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052372 Nov 28 20:19:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 166/497] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:19:48 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:19:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:19:48 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:19:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-2b8e8143-b188-4ec5-8f31-328f88fc3ec3 req-d141d8d1-6d3e-498f-b0f5-b9fe35bd9585 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040718 Nov 28 20:19:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 166/498] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-929fba57-a903-4c2a-942f-31a35eea9a72 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 204 len: 0 microversion: 2.1 time: 0.160021 Nov 28 20:19:48 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 167/499] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:19:48 2023] DELETE /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-unplugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] Creating event network-vif-unplugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:19:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cc400bc5-6e14-4c4a-8b10-a480f5ad232f req-b277f831-83b4-48cd-a110-de0a9c5da950 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031816 Nov 28 20:19:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 167/500] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1766072383", "imageRef": "", "flavorRef": "1", "key_name": "tempest-TestShelveInstance-752726007", "security_groups": [{"name": "tempest-secgroup-smoke-1041698521"}], "networks": [{"uuid": "559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7"}], "block_device_mapping_v2": [{"uuid": "eaa2b1ac-220a-42a8-99fd-893e37359fd9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] validate_networks() for [('559bc413-7eb0-4a2b-98d4-1c20cbb5a2a7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:19:49 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-90ab4deb-1570-4f09-a004-02197a0e2250 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 200 len: 1684 microversion: 2.1 time: 0.656263 Nov 28 20:19:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 167/501] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:48 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 1684 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting quotas for project 8bcf01c7a7d24806a2ffe82ec75c8a51. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:49 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Getting quotas for user ca4e178401f940438a766a048076af93 and project 8bcf01c7a7d24806a2ffe82ec75c8a51. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:50 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:19:50 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eaa2b1ac-220a-42a8-99fd-893e37359fd9',volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:19:50 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-46d20bc7-5c21-4855-a8ad-1feec13d476a tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.909121 Nov 28 20:19:50 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 168/502] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:19:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:19:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8153c951-63ad-4e3f-9c2b-4cc5fce024b1 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:50 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8153c951-63ad-4e3f-9c2b-4cc5fce024b1 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:50 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8153c951-63ad-4e3f-9c2b-4cc5fce024b1 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8153c951-63ad-4e3f-9c2b-4cc5fce024b1 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1081 microversion: 2.1 time: 0.132536 Nov 28 20:19:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 168/503] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:50 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1081 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-plugged", "status": "completed", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] Creating event network-vif-plugged:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:19:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-1856b361-b766-4dfe-8ff6-0897481219fe req-de624aaa-df88-4d55-a313-7f3100cf969a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050688 Nov 28 20:19:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 168/504] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-379425302", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "b45a9bdc-c522-435b-8532-28ec9780b49a"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] validate_networks() for [('b45a9bdc-c522-435b-8532-28ec9780b49a', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:53 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting quotas for project fc33efd1bb7f49679e13621e8dd3449a. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:19:53 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting quotas for user 24aa8ca42c7342fa91f5eab19b6c0c9b and project fc33efd1bb7f49679e13621e8dd3449a. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:19:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:19:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:19:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-01b77c32-a3d9-47ec-b399-0dee75946b47 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.695507 Nov 28 20:19:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 169/505] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:19:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:19:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d89c3ddc-c974-479f-8eaa-4915e8af440c tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d89c3ddc-c974-479f-8eaa-4915e8af440c tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:53 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d89c3ddc-c974-479f-8eaa-4915e8af440c tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:19:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d89c3ddc-c974-479f-8eaa-4915e8af440c tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1208 microversion: 2.1 time: 0.162768 Nov 28 20:19:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 169/506] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:53 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1208 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:19:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4000485-c53c-46e7-b585-cec40c114ec9", "name": "network-vif-deleted", "tag": "0bae30f2-569a-4d1d-8e35-77ad39e87209"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] Creating event network-vif-deleted:0bae30f2-569a-4d1d-8e35-77ad39e87209 for instance b4000485-c53c-46e7-b585-cec40c114ec9 on user Nov 28 20:19:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6d136346-a82a-4167-82d8-b57cd385aae1 req-a9354ee7-14d6-4203-8877-c0039d5ec89a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055051 Nov 28 20:19:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 169/507] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] Creating event network-changed:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:19:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-4c4f45e0-f929-4a63-9c47-68d78d79a6da req-568e73b0-04c5-481c-9565-b250a5c76826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109774 Nov 28 20:19:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 170/508] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] Creating event network-changed:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:19:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-ff6c1348-ea8e-43c5-84d9-34d30936e2ad req-4ee1cfac-0af6-4232-a0ff-75fd99e620b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047019 Nov 28 20:19:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 170/509] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:56 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:56 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3129b98d-bf00-40ee-a41d-fe585660bcf0 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.191846 Nov 28 20:19:56 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 170/510] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:19:56 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-interface => generated 282 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: fc91159a-f3ce-4674-b9e4-a548d373471b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] HTTP exception thrown: Instance fc91159a-f3ce-4674-b9e4-a548d373471b could not be found. Nov 28 20:19:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Returning 404 to user: Instance fc91159a-f3ce-4674-b9e4-a548d373471b could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:19:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8e692b4b-6408-4ed9-b98e-75409478b979 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b" status: 404 len: 111 microversion: 2.1 time: 0.028770 Nov 28 20:19:57 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 171/511] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:57 2023] GET /compute/v2.1/servers/fc91159a-f3ce-4674-b9e4-a548d373471b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:19:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-37abdd6a-783e-4894-80ad-c958fa286736 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '.version_select at 0x7f9e643139a0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-37abdd6a-783e-4894-80ad-c958fa286736 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526921959" status: 202 len: 0 microversion: 2.1 time: 0.036242 Nov 28 20:19:57 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 171/512] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:19:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526921959 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:19:57 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:57 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] Creating event network-changed:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:19:57 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-4ab46b9f-0455-4410-800e-73a57e5e2f3a req-01f345f5-2269-431b-bfba-08002a4447bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031702 Nov 28 20:19:57 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 171/513] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1590688573"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: 785632ec-4b56-4fca-82a5-67e3d52de9cb] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] HTTP exception thrown: Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb could not be found. Nov 28 20:19:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Returning 404 to user: Instance 785632ec-4b56-4fca-82a5-67e3d52de9cb could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:19:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-03213847-a985-45d2-a6cb-98262e8bf1b3 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb" status: 404 len: 111 microversion: 2.1 time: 0.040885 Nov 28 20:19:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 172/514] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:19:58 2023] GET /compute/v2.1/servers/785632ec-4b56-4fca-82a5-67e3d52de9cb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:19:58 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "name": "network-vif-plugged", "status": "completed", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:19:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:19:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:19:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:19:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] Creating event network-vif-plugged:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:19:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d5946a3f-c0f4-4fe4-9d72-c14c9c9d62b9 req-d20720b5-1f5f-4a79-a86d-b323c30f24df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072798 Nov 28 20:19:58 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 172/515] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:19:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-78f61cfc-46ed-4b56-b069-4304abf670ac tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action" status: 202 len: 0 microversion: 2.1 time: 1.531680 Nov 28 20:19:59 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 172/516] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:19:58 2023] POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action => generated 0 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 20:19:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-44fc02e6-0eaf-4094-8b74-36e20ff1278d tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '.version_select at 0x7f9e6446e9e0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:19:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-44fc02e6-0eaf-4094-8b74-36e20ff1278d tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308" status: 200 len: 1607 microversion: 2.1 time: 0.054857 Nov 28 20:19:59 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 173/517] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 20:19:59 2023] GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308 => generated 1607 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "name": "network-vif-plugged", "status": "completed", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] Creating event network-vif-plugged:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:20:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-a191e11d-0212-4a31-a061-60876b0cc65d req-68dc3232-1bef-4c38-87f1-77fe32c139d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044308 Nov 28 20:20:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 173/518] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:02 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270de3ab19964431afa20c767af7b23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4056e8f34a4e8da54592d28d7a75a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-31f6c61a-31e9-412f-919b-f8c35e4c9807 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 200 len: 1591 microversion: 2.1 time: 0.267318 Nov 28 20:20:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:02 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 1591 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:20:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-2454f814-8a03-41f9-807d-195b5fcb783c req-b71309c6-0bb4-496a-b652-a165c1716a4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067665 Nov 28 20:20:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 174/520] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:20:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3dc0d76f-2f42-4768-a270-cff85f6b726e req-d3a5eded-37c6-4e43-918e-510c38f912d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051244 Nov 28 20:20:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 174/521] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=16 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] HTTP exception thrown: Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d is not attached to volume 55971858-8dd0-45f6-ba68-a481db871e91 Nov 28 20:20:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Returning 404 to user: Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d is not attached to volume 55971858-8dd0-45f6-ba68-a481db871e91 {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:20:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4c741d18-7bb1-44bc-b9bd-c3a96c7d833a tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments/55971858-8dd0-45f6-ba68-a481db871e91" status: 404 len: 154 microversion: 2.1 time: 0.112025 Nov 28 20:20:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 174/522] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:20:06 2023] DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d/os-volume_attachments/55971858-8dd0-45f6-ba68-a481db871e91 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:20:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] Creating event network-changed:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:07 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:20:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-25bf1ec0-6288-4099-906a-2d6d91422990 req-4a8304b1-2026-44b8-b890-2cb483880fd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048773 Nov 28 20:20:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 175/523] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a5a3bc66-68b2-4c3f-8469-4f1a1af48a50 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 204 len: 0 microversion: 2.1 time: 0.148077 Nov 28 20:20:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 175/524] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:20:07 2023] DELETE /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:07 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29664fb367db470abbd15cfbf39dd38a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '742419219fb94804bef60efd10716a41', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5ed3e53b-2030-45c2-ad1e-9efd0b6699ae tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 200 len: 1659 microversion: 2.1 time: 0.262915 Nov 28 20:20:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 175/525] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:07 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 1659 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-unplugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}, {"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-plugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}, {"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-plugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}, {"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-plugged", "status": "completed", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Creating event network-vif-unplugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Creating event network-vif-plugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Creating event network-vif-plugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] Creating event network-vif-plugged:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-954a4122-5f6f-4049-84ac-ce68ce9b4d58 req-e71f3693-6563-47ca-8035-dd3fd3776a7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.036929 Nov 28 20:20:09 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 176/526] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:09 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8112c4a-cb42-49df-81a7-97b42f5cc87d", "name": "network-vif-deleted", "tag": "11217ca7-1cb1-404d-8a7c-a8a33ff80098"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] Creating event network-vif-deleted:11217ca7-1cb1-404d-8a7c-a8a33ff80098 for instance a8112c4a-cb42-49df-81a7-97b42f5cc87d on user Nov 28 20:20:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0eb738f6-8ff4-46f0-8b78-ed6ea99839d9 req-ba0b5dab-d6e8-486e-9350-3c5f43e24f68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Nov 28 20:20:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 176/527] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-fad9f437-3bad-426a-8b2c-829c99761ba4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: .version_select at 0x7f9e64415f30>, body: {"keypair": {"name": "tempest-keypair-1730482313", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEe+U0yATBZxQ9869JR+Ry2x+zXaAsyzCIkLVlxJuCzBwEDsBg6c7RuNJ8gA/Szm2NBEa0jvxejV7Y8Q4TuJC8bs5g+QCEs7wblJAv8NhiTw7iVdzrfIqdsDfMskYQkNvA=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:14 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-fad9f437-3bad-426a-8b2c-829c99761ba4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for project 548f7955f73e434cb014eeaeffa2824f. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:20:14 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-fad9f437-3bad-426a-8b2c-829c99761ba4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for user 740070b2e6434ca9a733cb932663572c and project 548f7955f73e434cb014eeaeffa2824f. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:20:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-fad9f437-3bad-426a-8b2c-829c99761ba4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045220 Nov 28 20:20:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 176/528] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:20:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1332545386", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "80eb1442-8e05-4d31-96b5-26df5f47f887"}], "security_groups": [{"name": "tempest-securitygroup--837642769"}], "key_name": "tempest-keypair-1730482313", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:16 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] validate_networks() for [('80eb1442-8e05-4d31-96b5-26df5f47f887', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for project 548f7955f73e434cb014eeaeffa2824f. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Getting quotas for user 740070b2e6434ca9a733cb932663572c and project 548f7955f73e434cb014eeaeffa2824f. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:20:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:20:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-36c27264-2849-450f-9669-e5213bba5148 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.539507 Nov 28 20:20:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 177/529] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:20:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:20:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c454d41a-5343-41c5-8b39-78cdfdf39e35 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c454d41a-5343-41c5-8b39-78cdfdf39e35 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c454d41a-5343-41c5-8b39-78cdfdf39e35 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c454d41a-5343-41c5-8b39-78cdfdf39e35 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f" status: 200 len: 1235 microversion: 2.1 time: 0.059819 Nov 28 20:20:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 177/530] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:17 2023] GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f => generated 1235 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:19 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a7b2a7df-b179-4084-8e96-163d47dd4792 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1715 microversion: 2.1 time: 0.441677 Nov 28 20:20:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 177/531] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:19 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1715 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] Creating event network-changed:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:20:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-bb908d98-0050-4a39-9558-b8046ca48f2d req-3837c903-8154-4f5b-a3d7-41b55f97ecd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038744 Nov 28 20:20:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 178/532] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "name": "network-vif-plugged", "status": "completed", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:21 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] Creating event network-vif-plugged:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:20:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-598afd9d-59b9-4f75-89f4-b6930ffe959f req-de5005fc-71fb-494e-b1e1-10d8e5a38533 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036021 Nov 28 20:20:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 178/533] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "name": "network-vif-plugged", "status": "completed", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] Creating event network-vif-plugged:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:20:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-2fcb7614-4cd9-480a-829a-75c2dfc9a8f2 req-595978f3-57f3-4ec5-925d-4ebfe461d4f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029541 Nov 28 20:20:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 178/534] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-519855433", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a"}]}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] validate_networks() for [('60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=36 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for user 007af37c9a914cd5863e486c041701be and project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:20:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:20:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-03800733-4c82-4690-a266-eb3b7987ef99 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.991490 Nov 28 20:20:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 179/535] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:20:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 995 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:20:29 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:30 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:30 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:30 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c3f66b85-071e-41e3-b7b0-7974a859a54e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1394 microversion: 2.87 time: 0.081958 Nov 28 20:20:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 179/536] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:20:29 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1394 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:20:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] Creating event network-changed:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:20:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-09c4f48c-e5ef-48a5-b69d-532731da1d93 req-4ac0efec-dcaa-407e-b0e8-8d5ae4e4ebcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060069 Nov 28 20:20:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 179/537] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f0c2fcad-3aed-4fec-8340-2d324996fbb6 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.179362 Nov 28 20:20:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 180/538] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:20:38 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-interface => generated 283 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] Creating event network-changed:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:20:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-92b0f01d-722c-412a-8cb6-ca1f248a53e0 req-3d50b159-7a8b-4db8-bc66-25deb76988d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034424 Nov 28 20:20:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 180/539] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: b4000485-c53c-46e7-b585-cec40c114ec9] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HTTP exception thrown: Instance b4000485-c53c-46e7-b585-cec40c114ec9 could not be found. Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Returning 404 to user: Instance b4000485-c53c-46e7-b585-cec40c114ec9 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:20:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0218e591-ee9a-4495-9bb7-af383f21397e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9" status: 404 len: 111 microversion: 2.1 time: 0.028591 Nov 28 20:20:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 181/540] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:39 2023] GET /compute/v2.1/servers/b4000485-c53c-46e7-b585-cec40c114ec9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:20:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-09f1518e-be7f-4d69-87b5-6afb8bb728bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '.version_select at 0x7f9e6446dcf0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-09f1518e-be7f-4d69-87b5-6afb8bb728bf tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082993848" status: 202 len: 0 microversion: 2.1 time: 0.021346 Nov 28 20:20:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 181/541] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:20:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1082993848 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:20:39 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d0df4f1f-42ec-4d60-b739-700204455561 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 200 len: 1564 microversion: 2.1 time: 0.340188 Nov 28 20:20:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:39 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 1564 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Searching by: {'deleted': False, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a'} {{(pid=65585) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG nova.compute.multi_cell_list [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 20:20:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cf7b6018-efe6-4925-a905-dedf7ea4d893 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 350 microversion: 2.1 time: 0.180677 Nov 28 20:20:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 182/543] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 20:20:39 2023] GET /compute/v2.1/servers => generated 350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e915d297-00e2-402f-9c40-530a71954224"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e3ac0c5b-1446-43d1-864d-cad1fce90ce5 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321812 Nov 28 20:20:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 182/544] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:20:40 2023] POST /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3c4c72c6-b017-4337-aef7-f29da05f69cd tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.232031 Nov 28 20:20:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 181/545] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:40 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-eb03c735-723d-4838-9448-42718801311b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1431 microversion: 2.1 time: 0.240260 Nov 28 20:20:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 183/546] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:40 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1431 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:40 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d639270a-e2e1-4b81-ac4a-9774422a12d2 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.197738 Nov 28 20:20:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 183/547] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:40 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:41 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0f85cb04-91e8-4ea4-aba6-aa4f86a476a4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1658 microversion: 2.1 time: 0.159406 Nov 28 20:20:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 182/548] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:40 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1658 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:43 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-175f85ed-0bd6-4a56-80b2-1bbeb5eba269 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1491 microversion: 2.1 time: 0.211993 Nov 28 20:20:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 184/549] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:43 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1491 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:47 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:20:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-000ce3b0-2a0f-4c9c-ab86-6824893c3f2b req-4278f3e7-b7d9-4cf1-985f-cf36300d4a07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031748 Nov 28 20:20:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 184/550] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:20:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1add6df3-34ee-435d-a88b-f1956d15374d req-1af52ade-626e-4af3-9eab-5654fe747f2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034210 Nov 28 20:20:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 183/551] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ac13682b-4a1b-4f28-adba-79ef08ba2c26 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '.version_select at 0x7f9e6449b520>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ac13682b-4a1b-4f28-adba-79ef08ba2c26 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308" status: 200 len: 1721 microversion: 2.1 time: 0.057525 Nov 28 20:20:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 185/552] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 20:20:49 2023] GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308 => generated 1721 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3ab5ca92-01bc-4a74-9469-50f569ff4b47 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '.version_select at 0x7f9e645413f0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3ab5ca92-01bc-4a74-9469-50f569ff4b47 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308" status: 200 len: 1721 microversion: 2.1 time: 0.053758 Nov 28 20:20:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 185/553] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Nov 28 20:20:49 2023] GET /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308 => generated 1721 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:49 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:20:50 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0cf93a17-f90d-4d59-a03f-78c822bd6549 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1667 microversion: 2.1 time: 0.240424 Nov 28 20:20:50 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 184/554] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:49 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1667 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG nova.compute.api [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6e7ce3bd-a416-475f-97ec-5735a6bef904 req-cdbb787d-94e8-46c5-b853-630b5b3de644 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.154934 Nov 28 20:20:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 186/555] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:50 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cc3c9183-dd9a-4739-8ad1-0dc9e3fd5b52 req-ab7dd925-e465-4e47-a174-2380c7cc5443 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.106795 Nov 28 20:20:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 186/556] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:51 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-01612be8-641e-43c2-9e73-b69cf2dd6d5a req-2c0a1165-a771-4c25-a0f6-45656da9c76f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.092490 Nov 28 20:20:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 185/557] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:51 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG nova.compute.api [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3c550ce8-acd4-4e17-b3ac-477488318c86 req-0dff4be2-d1d3-446c-a19c-d7f93b5c761c tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.129104 Nov 28 20:20:52 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 187/558] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:51 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-6d1684a4-6d61-455d-b0b8-205797630e18 req-79eb1528-7992-423b-88b0-d2b0df303a0f tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.082917 Nov 28 20:20:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 187/559] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:52 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-cb808c92-4bb7-4517-9558-9d6f2deb39b3 req-a6ea8ef6-7cee-4039-874d-15b90bceec2e tempest-TestServerVolumeAttachmentScenario-2078748670 tempest-TestServerVolumeAttachmentScenario-2078748670-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 200 len: 302 microversion: 2.89 time: 0.083624 Nov 28 20:20:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 186/560] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:20:52 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 302 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-359345bc-4f69-4cb0-8819-8d7e2a679257 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367155 Nov 28 20:20:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 188/561] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:20:53 2023] POST /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 194 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] [instance: a8112c4a-cb42-49df-81a7-97b42f5cc87d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:20:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] HTTP exception thrown: Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d could not be found. Nov 28 20:20:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Returning 404 to user: Instance a8112c4a-cb42-49df-81a7-97b42f5cc87d could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:20:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-64aafcb8-ca17-4c37-a2bc-84bc8b433531 tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d" status: 404 len: 111 microversion: 2.1 time: 0.026675 Nov 28 20:20:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 188/562] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:20:58 2023] GET /compute/v2.1/servers/a8112c4a-cb42-49df-81a7-97b42f5cc87d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:21:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7b3ea778-cea7-4bf9-a303-c0c022940e9b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] Calling method '.version_select at 0x7f9e6475cdc0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7b3ea778-cea7-4bf9-a303-c0c022940e9b tempest-TestStampPattern-152273837 tempest-TestStampPattern-152273837-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-550063434" status: 202 len: 0 microversion: 2.1 time: 0.022826 Nov 28 20:21:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 187/563] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Nov 28 20:21:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-550063434 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-45e6f7b8-efeb-4c27-9634-5802c557d905 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.291909 Nov 28 20:21:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 189/564] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:21:02 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-interface => generated 282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] Creating event network-changed:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:21:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-8ca3b519-a3a5-4443-b262-8b0ac2e24108 req-2106387c-0a98-4d91-810b-df30bbb71000 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063307 Nov 28 20:21:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 189/565] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=48 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:03 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'services' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:21:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3bd2cff0-7f59-45a0-aee0-3fd26a9fbd9d tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a" status: 202 len: 0 microversion: 2.1 time: 0.172128 Nov 28 20:21:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 190/566] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:21:04 2023] DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/1f6d4c4e-8972-4d0e-bbcb-fe282a41e20a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2397592b-edd5-428e-9a7c-0d2bc690b00b tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049285 Nov 28 20:21:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 190/567] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:21:04 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 371 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:05 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270de3ab19964431afa20c767af7b23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4056e8f34a4e8da54592d28d7a75a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-49d26689-a899-4559-936a-620bf700ef80 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 200 len: 1591 microversion: 2.1 time: 1.131288 Nov 28 20:21:05 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 188/568] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:03 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 1591 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:07 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7ca4e7c2-50c8-4033-83f2-ac27d39e55b4 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f" status: 200 len: 1542 microversion: 2.1 time: 0.283986 Nov 28 20:21:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 191/569] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:07 2023] GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f => generated 1542 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "13a8c230-3a9c-4a6d-af71-206fd7925ac2"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-20efad71-8349-4499-b6f9-a6b98281064f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335889 Nov 28 20:21:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 191/570] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:21:08 2023] POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:19 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:19 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=11 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ef02348f-1b5f-4fc5-a30b-5fbde14b5b87 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/action" status: 202 len: 0 microversion: 2.1 time: 0.513166 Nov 28 20:21:20 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 189/571] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:21:19 2023] POST /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=13 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:20 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3b8998a7-b3aa-4f95-9b7e-35e06669a47a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1768 microversion: 2.87 time: 0.235747 Nov 28 20:21:20 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 192/572] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:21:20 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1768 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:21:20 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-15c4939f-2c17-4517-afce-f2cb3177e807 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1714 microversion: 2.1 time: 0.213890 Nov 28 20:21:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 192/573] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:20 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1714 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-unplugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Creating event network-vif-unplugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:21:21 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:21:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a15e4380-c123-423c-81f3-5ca23248e8e6 req-687916df-e2bf-4413-a7f4-f54edefb08b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096772 Nov 28 20:21:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 190/574] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:23 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:21:23 user devstack@n-api.service[65585]: DEBUG nova.compute.api [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:21:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-0d18b013-c556-4996-8d7e-ee3753ef5e43 req-9b1641d4-9477-4c9d-be63-e974b8d25a64 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049069 Nov 28 20:21:23 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 193/575] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:31 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'services' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:21:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2909c925-d5d4-4dcf-be62-6e551f2806ad tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/13a8c230-3a9c-4a6d-af71-206fd7925ac2" status: 202 len: 0 microversion: 2.1 time: 0.198792 Nov 28 20:21:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 193/576] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:21:31 2023] DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/13a8c230-3a9c-4a6d-af71-206fd7925ac2 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-07a7eccb-0ead-42b3-805d-96e2f6503f78 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087974 Nov 28 20:21:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 191/577] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:21:31 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:21:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] Instance 40ac5386-d43f-443c-ac15-186b368728f8 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65585) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:21:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7de73050-367a-475a-bc86-7ddc6ace7033 req-80e09441-465a-496c-9933-3eb4b6772930 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055988 Nov 28 20:21:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 194/578] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:21:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a8048378-9f0e-497d-bf42-8f0038d08833 req-a22ce9cc-4591-46ac-aa2b-b5b2fa4b0c2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028749 Nov 28 20:21:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 194/579] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:41 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7e91ec25-db09-4d77-b003-69748d7ac2c3 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1431 microversion: 2.1 time: 0.261410 Nov 28 20:21:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 192/580] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:40 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1431 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:43 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-135830086", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "b45a9bdc-c522-435b-8532-28ec9780b49a"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:43 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] validate_networks() for [('b45a9bdc-c522-435b-8532-28ec9780b49a', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:21:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] Creating event network-changed:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d859f98d-2b23-4050-b3b2-813a0e6a2bbc req-91e2692b-dfb7-4046-bd98-9725d34c22c5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115412 Nov 28 20:21:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 195/581] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lazy-loading 'flavor' on Instance uuid f95d416b-d3b7-4b16-adc7-83a06088e167 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8418bd38-5f4a-4fb0-9455-2cb00d91a872 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167/action" status: 202 len: 0 microversion: 2.1 time: 0.214097 Nov 28 20:21:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 193/582] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:21:44 2023] POST /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting quotas for project fc33efd1bb7f49679e13621e8dd3449a. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Getting quotas for user 24aa8ca42c7342fa91f5eab19b6c0c9b and project fc33efd1bb7f49679e13621e8dd3449a. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:21:44 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:21:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5678d8c7-723a-448f-af97-2b7e2c9c9157 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.823223 Nov 28 20:21:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 195/583] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:21:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-23664939-1d6f-49d9-9f6b-24ad14767a5f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-23664939-1d6f-49d9-9f6b-24ad14767a5f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:44 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-23664939-1d6f-49d9-9f6b-24ad14767a5f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-23664939-1d6f-49d9-9f6b-24ad14767a5f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 200 len: 1208 microversion: 2.1 time: 0.083377 Nov 28 20:21:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 194/584] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:44 2023] GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:44 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-89de7979-0200-43df-943d-e1e84a65433d tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1555 microversion: 2.1 time: 0.279597 Nov 28 20:21:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 196/585] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:44 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:21:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-unplugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Creating event network-vif-unplugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-584fbc09-3fd8-40ea-a4c7-7bc149987a5d req-07921258-2b2c-4abd-b87b-1e22c5200cbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.060355 Nov 28 20:21:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 196/586] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:45 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:21:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] Creating event network-changed:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-2ed5eb0a-13de-495b-b154-e2df41999126 req-cacc4252-2fff-442b-9144-fd98ce7473b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039554 Nov 28 20:21:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 195/587] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestOtherA-server-1507891953", "imageRef": "", "flavorRef": "1", "networks": [{"uuid": "8cc12ce3-3e35-45e4-bbee-b5d66b5b468b"}], "security_groups": [{"name": "tempest-securitygroup--1965786445"}], "key_name": "tempest-keypair-344088806", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "12945667-6430-4669-b816-315eefdfd6f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] validate_networks() for [('8cc12ce3-3e35-45e4-bbee-b5d66b5b468b', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:21:47 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='12945667-6430-4669-b816-315eefdfd6f8',volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:21:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-unplugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"name": "network-changed", "server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Creating event network-vif-unplugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:21:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] Creating event network-changed:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:21:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3f8c6974-c450-4d83-8226-77d81e0fabbc req-69eca71f-5674-4e62-a714-1bc0412f534c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.032065 Nov 28 20:21:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 197/588] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:47 2023] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b5bb2edf-cfc4-404a-bc7e-75ecf926bf3d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.880738 Nov 28 20:21:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 197/589] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:21:47 2023] POST /compute/v2.1/servers => generated 404 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:21:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c96036b7-ba94-4b2d-b3e3-79ed2769fdce tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c96036b7-ba94-4b2d-b3e3-79ed2769fdce tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:48 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-c96036b7-ba94-4b2d-b3e3-79ed2769fdce tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c96036b7-ba94-4b2d-b3e3-79ed2769fdce tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1075 microversion: 2.1 time: 0.071100 Nov 28 20:21:48 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 196/590] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:48 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1075 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] Creating event network-vif-plugged:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:21:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-c687c1c0-1f05-47cb-9dbd-a9709017bdd3 req-d75f4a3e-3922-4aee-8e5f-7b53676fe69d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037158 Nov 28 20:21:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 198/591] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:50 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:21:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9262b9bc-a571-4266-a6cb-885fc9d5b59b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1667 microversion: 2.1 time: 0.231473 Nov 28 20:21:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 198/592] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:21:50 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1667 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5a18686-4ce1-48a9-8657-5d9ca9a6f618"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-52fa21f3-c47c-4e23-8c94-94efbeba8d87 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354315 Nov 28 20:21:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 197/593] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:21:50 2023] POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments => generated 194 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}, {"name": "network-changed", "server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:21:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Creating event network-vif-plugged:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:21:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] Creating event network-changed:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:21:52 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-c9937bcd-89bc-4988-88c9-4a1fa57881c4 req-621e6f6e-1f59-411d-91e2-68d97a07eb5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036510 Nov 28 20:21:52 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0e1c2cdd-dd88-490a-b97d-619887a444f9 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047632 Nov 28 20:21:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 199/595] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:21:54 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:54 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lazy-loading 'services' on Instance uuid 0061bf04-e594-4e9c-aeb1-5a29bb299749 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:21:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7adf31f1-90a1-4b42-aeef-d360845613f0 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 202 len: 0 microversion: 2.1 time: 0.172032 Nov 28 20:21:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 198/596] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:21:54 2023] DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:21:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:21:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bc3a0d33-5355-407d-99d2-94703b47204f tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054968 Nov 28 20:21:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 200/597] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:21:55 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:22:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-26ef4cee-ceee-4286-8355-4d9595c71fea req-e876080b-784c-4bdb-b667-75ce3f3b509e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103493 Nov 28 20:22:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 200/598] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "f77204ba-f257-4f61-8ad9-2a67f408d308"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:02 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'flavor' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:22:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-167c6ad0-002e-4b21-953b-ece2727aa5bf tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action" status: 200 len: 29 microversion: 2.1 time: 0.238140 Nov 28 20:22:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 199/599] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:22:02 2023] POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action => generated 29 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:02 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5fd513ce-5bd6-46e7-be94-32b4de39b4e1 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1719 microversion: 2.1 time: 0.380056 Nov 28 20:22:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 201/600] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:02 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1719 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:02 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:22:02 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-44c37c82-56de-43a7-bfe6-e381c90c3bee req-d9bada63-2802-4beb-9136-ed6bffbd0982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057509 Nov 28 20:22:02 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 201/601] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-unplugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] Creating event network-vif-unplugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:22:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-21f8161a-a34e-44fb-8a73-8202ca3e4e6d req-c3f4349c-1c38-4a7f-a9ec-cc183068183f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034498 Nov 28 20:22:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 200/602] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:22:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-6732e0f5-2341-4bfe-ad3d-53ebecd43c1e req-546f96ae-9038-49bf-a21a-224ac90ec9af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033708 Nov 28 20:22:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 202/603] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4c784c5a-20e4-4806-8b08-3c6960efefa2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.325472 Nov 28 20:22:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 202/604] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:22:07 2023] GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-interface => generated 283 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:22:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7785fdd0-a179-4247-8cfc-9292d3d4cad7 req-038224ed-b1e1-4c23-a5b8-76e25eec9b46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048216 Nov 28 20:22:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 201/605] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4045789-f468-4f00-85df-81a587322427", "device": "/dev/vdb"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:10 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bd8fda48-f980-475d-b207-cf0a294d6570 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754874 Nov 28 20:22:10 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 203/606] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:22:09 2023] POST /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-volume_attachments => generated 194 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}, {"name": "network-changed", "server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:22:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] Creating event network-changed:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:22:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1659145c-e827-4a6a-9630-9d09a2e6f2f5 req-741b437d-1830-49e1-b944-8cfea77e40e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046288 Nov 28 20:22:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 202/607] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:10 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ae4ea131-79f6-4915-95cd-dd518ed6848f tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1707 microversion: 2.1 time: 0.273365 Nov 28 20:22:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 203/608] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:10 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1707 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "1c3ba19f-034b-4575-988e-5ba1959e6b6e"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:21 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'flavor' on Instance uuid 313a065e-94f3-4435-97af-6a16de64ca7c {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=9,nova_cell1:INSERT=5 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4bee049e-b3fc-44a2-861d-790a336593ef tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076196 Nov 28 20:22:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 203/609] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:22:21 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:22:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7c1ab654-6768-495a-a91f-764950df9e60 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c/action" status: 200 len: 29 microversion: 2.87 time: 0.725106 Nov 28 20:22:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 204/610] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:22:20 2023] POST /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c/action => generated 29 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=40 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:21 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a1238991-d2e3-4d18-999b-a9f6421eff48 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1774 microversion: 2.87 time: 0.267358 Nov 28 20:22:21 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 204/611] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:22:21 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1774 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:22:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] Creating event network-vif-unplugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:22:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-6bb994c7-d70d-4763-a3ba-3cbbc9f9e320 req-0e6b0c30-7dc9-4acd-845c-7a7518daa502 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036218 Nov 28 20:22:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 204/612] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61c58bb2-320d-4d0d-8e14-a985e77aa189"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-44d8eeb9-44f2-4ddd-9601-ff7a4d43887e tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.497431 Nov 28 20:22:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 205/613] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:22:24 2023] POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:22:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-80e63cfb-2c4e-4f5d-ad18-b43607319e03 req-586adf5c-de5b-4f10-a1d5-36471f39a59d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040197 Nov 28 20:22:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 205/614] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:22:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-21d943c1-fe3d-46ad-87c9-77b0d5472504 req-1019549c-7753-42ed-965c-30c8599bcebb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032913 Nov 28 20:22:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 205/615] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:22:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-19ad7c4e-86d7-4c00-a598-0c66fd935818 req-d67520e4-e321-48ae-a8c0-6c62608cd53d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Nov 28 20:22:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 206/616] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:34 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3fc9dd73-c44c-4716-89a1-9b3f9b4a47f9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 200 len: 1491 microversion: 2.1 time: 0.248796 Nov 28 20:22:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 206/617] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:34 2023] GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 1491 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6aba8590-18bc-4e26-bf28-bf7727080de2 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1496 microversion: 2.1 time: 0.238657 Nov 28 20:22:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 206/618] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:34 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1496 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:38 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'services' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:22:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ccfbf695-475b-495f-82dc-9ee335fa2cc4 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1430 microversion: 2.1 time: 0.329170 Nov 28 20:22:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 207/619] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:38 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1430 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-08b2f7b9-486e-47f2-899c-93105b57a267 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/61c58bb2-320d-4d0d-8e14-a985e77aa189" status: 202 len: 0 microversion: 2.1 time: 0.603408 Nov 28 20:22:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 207/620] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:22:38 2023] DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/61c58bb2-320d-4d0d-8e14-a985e77aa189 => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-43dc3b1d-d737-4445-a932-1889671c8851 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042693 Nov 28 20:22:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 207/621] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:22:38 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lazy-loading 'services' on Instance uuid 2f47c1e6-8450-4e8c-bfc7-99041345ab4f {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:22:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5ab4cb7f-247b-4ab4-a1fc-642687c15939 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-volume_attachments/c4045789-f468-4f00-85df-81a587322427" status: 202 len: 0 microversion: 2.1 time: 0.168820 Nov 28 20:22:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 208/622] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:22:40 2023] DELETE /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f/os-volume_attachments/c4045789-f468-4f00-85df-81a587322427 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:22:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-348ad07b-f3a0-4fc8-9bbb-271fc4d48a7e tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f" status: 204 len: 0 microversion: 2.1 time: 0.132443 Nov 28 20:22:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 208/623] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:22:40 2023] DELETE /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:40 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '740070b2e6434ca9a733cb932663572c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '548f7955f73e434cb014eeaeffa2824f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-dc0f0cbe-e31f-4a6e-be7e-f86d72641e06 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f" status: 200 len: 1712 microversion: 2.1 time: 0.197002 Nov 28 20:22:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 208/624] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:40 2023] GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f => generated 1712 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-55eb5b21-776a-4263-99bb-0c2a6c037a25 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047193 Nov 28 20:22:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 209/625] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:22:45 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] HTTP exception thrown: Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 is not attached to volume e915d297-00e2-402f-9c40-530a71954224 Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Returning 404 to user: Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 is not attached to volume e915d297-00e2-402f-9c40-530a71954224 {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:22:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bb3aa6ee-1ed1-40bc-8812-220ddc015760 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224" status: 404 len: 154 microversion: 2.1 time: 0.087928 Nov 28 20:22:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 209/626] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:22:45 2023] DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749/os-volume_attachments/e915d297-00e2-402f-9c40-530a71954224 => generated 154 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:22:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b8a8208e-7c71-42ea-8df3-8f3b65900c60 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 204 len: 0 microversion: 2.1 time: 0.265307 Nov 28 20:22:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 209/627] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:22:45 2023] DELETE /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcac1e80fd41480b9250746018d93e2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0b00222407b41f99d3b983afaeb6c5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-18241dc7-395b-4a01-99a3-911459bb770e tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 200 len: 1689 microversion: 2.1 time: 0.227715 Nov 28 20:22:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 210/628] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:45 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "name": "network-vif-unplugged", "status": "completed", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] Creating event network-vif-unplugged:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:22:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-bde0455d-2c21-4d3a-9fe9-59cc2fdddb7a req-6d813f22-a75f-4033-80c8-51abc20ad29e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035546 Nov 28 20:22:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 210/629] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:47 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "name": "network-vif-deleted", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:47 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] Creating event network-vif-deleted:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:22:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-91411ca4-7d0e-4911-b946-0efadf0cb616 req-ecf7318f-acc5-470c-b2fa-693ffc4f4b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031252 Nov 28 20:22:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 210/630] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0061bf04-e594-4e9c-aeb1-5a29bb299749", "name": "network-vif-plugged", "status": "completed", "tag": "d90f48df-d39d-4f9e-b484-7cafb58c032d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:22:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] Creating event network-vif-plugged:d90f48df-d39d-4f9e-b484-7cafb58c032d for instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 on user Nov 28 20:22:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cd59b5cb-eec0-4045-90e5-78df9cf24353 req-18344ab3-5baf-4a81-9fa8-48c1a17e55fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036180 Nov 28 20:22:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 211/631] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:22:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:22:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:22:53 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:22:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3baa9d83-66f5-4b6c-9f66-16a70578224b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1699 microversion: 2.1 time: 0.249306 Nov 28 20:22:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 211/632] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:22:52 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1699 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "name": "network-vif-unplugged", "status": "completed", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] Creating event network-vif-unplugged:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:23:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b99ef5d6-1dea-43d6-963c-2fd353af42d9 req-1026fc83-455a-4296-946f-bc03067464a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036901 Nov 28 20:23:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 211/633] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=16 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "name": "network-vif-deleted", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] Creating event network-vif-deleted:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:23:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1902d0a4-a77c-4570-a969-b83b49cf17dc req-4915f781-7a4a-46d5-b4d6-536ce55113bf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036120 Nov 28 20:23:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 212/634] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f47c1e6-8450-4e8c-bfc7-99041345ab4f", "name": "network-vif-plugged", "status": "completed", "tag": "0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] Creating event network-vif-plugged:0a2c8a4a-7cfd-437e-abce-c3b79ba9fabf for instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f on user Nov 28 20:23:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-bdbc319a-c078-4f49-bcfe-8b15ece28fa4 req-345896fc-0983-4cb5-a8c6-117e3ac6c793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067279 Nov 28 20:23:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 212/635] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:11 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bff0c13a-bf30-494d-a4f4-11d9bf7fe880 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1707 microversion: 2.1 time: 0.205114 Nov 28 20:23:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 212/636] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:10 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:11 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8ba396f1-0ee9-488b-aef3-435bfcf3abaa tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1707 microversion: 2.1 time: 0.205870 Nov 28 20:23:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 213/637] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:11 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1707 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6f09a4a0-145e-42b1-90e8-aca1d5e92a4a tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1754 microversion: 2.87 time: 0.285886 Nov 28 20:23:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 213/638] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:23:12 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1754 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:23:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7131d226-4ec0-44e3-b189-dfe90c45260f tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045143 Nov 28 20:23:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 213/639] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:23:28 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] [instance: 2f47c1e6-8450-4e8c-bfc7-99041345ab4f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] HTTP exception thrown: Instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f could not be found. Nov 28 20:23:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Returning 404 to user: Instance 2f47c1e6-8450-4e8c-bfc7-99041345ab4f could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:23:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f3985bca-2e30-4a14-9326-3b3d857460d2 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f" status: 404 len: 111 microversion: 2.1 time: 0.033722 Nov 28 20:23:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 214/640] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:30 2023] GET /compute/v2.1/servers/2f47c1e6-8450-4e8c-bfc7-99041345ab4f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:23:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3d6c2b56-4e07-4d29-914e-50aa08274801 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] Calling method '.version_select at 0x7f9e6449a830>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:30 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:30 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3d6c2b56-4e07-4d29-914e-50aa08274801 tempest-VolumesSnapshotTestJSON-2135983630 tempest-VolumesSnapshotTestJSON-2135983630-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730482313" status: 202 len: 0 microversion: 2.1 time: 0.027156 Nov 28 20:23:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 214/641] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:23:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1730482313 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e364a33-a5d7-4aab-a5e4-df5722cafbcc"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-795c7737-c415-4b69-91c9-6ddc630e3115 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352253 Nov 28 20:23:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 214/642] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:23:31 2023] POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 194 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65585) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 20:23:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-dbf78dac-ee72-49cd-8756-c93b7a43f9ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 204 len: 0 microversion: 2.1 time: 0.122570 Nov 28 20:23:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 215/643] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:23:35 2023] DELETE /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-5407f047-dd85-4074-91c5-0594b966b768 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167/action" status: 202 len: 0 microversion: 2.1 time: 0.169124 Nov 28 20:23:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 215/644] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:23:35 2023] POST /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b42d5b68-e2a2-4e6a-9cfd-e8a2159798a9 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 200 len: 1497 microversion: 2.1 time: 0.279151 Nov 28 20:23:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 215/645] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:35 2023] GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 1497 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "name": "network-vif-unplugged", "status": "completed", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] Creating event network-vif-unplugged:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:23:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-edf884b9-29a7-460f-9918-4d84002a9c83 req-13f382bb-e61f-458d-813e-ac8de1aa1e62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032306 Nov 28 20:23:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 216/646] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ca6bdf18-96c3-4905-ad46-6fe71b0a99bd tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1504 microversion: 2.1 time: 0.498350 Nov 28 20:23:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 216/647] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:35 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] [instance: 0061bf04-e594-4e9c-aeb1-5a29bb299749] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] HTTP exception thrown: Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 could not be found. Nov 28 20:23:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Returning 404 to user: Instance 0061bf04-e594-4e9c-aeb1-5a29bb299749 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:23:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9944b49f-e7ca-404f-b03d-bc1d2077f10a tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749" status: 404 len: 111 microversion: 2.1 time: 0.034154 Nov 28 20:23:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 216/648] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:35 2023] GET /compute/v2.1/servers/0061bf04-e594-4e9c-aeb1-5a29bb299749 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:23:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-606704a1-94df-4877-b005-71eaa24bda05 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] Calling method '.version_select at 0x7f9e64498040>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-606704a1-94df-4877-b005-71eaa24bda05 tempest-TestServerVolumeAttachmentScenario-182534234 tempest-TestServerVolumeAttachmentScenario-182534234-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886893260" status: 202 len: 0 microversion: 2.1 time: 0.022978 Nov 28 20:23:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 217/649] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:23:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886893260 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:23:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "name": "network-vif-plugged", "status": "completed", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}, {"server_uuid": "11c97ebd-b684-4c98-9f49-57d25ea0c81b", "name": "network-vif-deleted", "tag": "7397580b-2855-4fab-b878-638f22ebbc53"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Creating event network-vif-plugged:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:23:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] Creating event network-vif-deleted:7397580b-2855-4fab-b878-638f22ebbc53 for instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b on user Nov 28 20:23:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-b7586180-7678-483b-83da-31a7bf331f6f req-2e7a382c-c000-40eb-9aef-68772f054c24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034405 Nov 28 20:23:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 217/650] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d9739d05-4815-4cf9-bdd3-a277c2128e50 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.154640 Nov 28 20:23:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 217/651] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:23:38 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/os-interface => generated 283 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] Creating event network-changed:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:23:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ff885c66-1ed2-4fa7-a571-d7e991669fc2 req-0c478121-fc84-4800-928b-9f31c751e4cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034333 Nov 28 20:23:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 218/652] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-731a70b9-524e-4f0c-b4b9-f27bd525bd7d tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1430 microversion: 2.1 time: 0.411544 Nov 28 20:23:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 218/653] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:39 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1430 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "2"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Old instance type m1.tiny, new instance type m1.small {{(pid=65587) resize /opt/stack/nova/nova/compute/api.py:4224}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for project a85595c9e1704e71903d25a65f5b696c. Resources: {'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Getting quotas for user 098319d33fa243f5a044cf3f3c9f983c and project a85595c9e1704e71903d25a65f5b696c. Resources: {'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:23:40 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:23:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3e66dd5a-fc47-4d52-91ba-52cc9f32de2a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action" status: 202 len: 0 microversion: 2.1 time: 0.606034 Nov 28 20:23:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 218/654] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:23:40 2023] POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:41 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:23:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3ab04025-bcf0-4de7-a26f-39a19d1ab9bc tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1439 microversion: 2.1 time: 0.238599 Nov 28 20:23:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 219/655] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:23:40 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1439 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:23:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] Creating event network-changed:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:23:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f9dadff8-cb0d-4e6e-9213-70d4dca3d33d req-44338890-9457-40fd-9282-c42fd23ad3ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050924 Nov 28 20:23:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 219/656] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-unplugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Creating event network-vif-unplugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:23:43 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] Instance 93392110-c3c3-44ff-a046-2f11608106c3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:23:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ff618e56-238a-4520-bdd7-fb38a576ec0d req-bf3fdf26-b61d-4b32-843d-7bd92e853474 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050275 Nov 28 20:23:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 219/657] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:45 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'services' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:23:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1a75413f-d7df-424c-b15d-3b901eacc108 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/7e364a33-a5d7-4aab-a5e4-df5722cafbcc" status: 202 len: 0 microversion: 2.1 time: 0.182844 Nov 28 20:23:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 220/658] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:23:45 2023] DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/7e364a33-a5d7-4aab-a5e4-df5722cafbcc => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4bbf57ee-d86d-4845-a325-431ed8cd918a tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052679 Nov 28 20:23:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 220/659] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:23:45 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:23:45 user devstack@n-api.service[65587]: DEBUG nova.compute.api [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] Instance 93392110-c3c3-44ff-a046-2f11608106c3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65587) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:23:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ca98b179-80a2-4f71-9ec6-bbb2bf6455cf req-4963cb5d-b15a-43e5-a4a3-883d57bcf70c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098664 Nov 28 20:23:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 220/660] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] Creating event network-changed:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:23:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-407e39db-d5c6-4654-8002-159a3b66b9d0 req-c49d1387-0983-4194-b4a4-4394286c7a14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032674 Nov 28 20:23:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 221/661] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:23:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1f8c6034-d5f4-4398-8231-0744d7865468 req-d91a55b7-d78d-4359-9c9d-caa49e147f72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066151 Nov 28 20:23:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 221/662] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:52 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:23:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:23:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ab5b75d1-4ca5-4ab4-8f13-40962e7b39c9 req-b076b82b-3759-4abe-8497-af952ae2ccec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Nov 28 20:23:52 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 221/663] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-77d5332e-a089-4990-b49f-9d5cd64bc43c tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action" status: 202 len: 0 microversion: 2.1 time: 0.395394 Nov 28 20:23:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 222/664] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:23:53 2023] POST /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f3455401-9fa0-4024-97a0-c2cf0c76f6a6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.258314 Nov 28 20:23:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 222/665] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:23:53 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-interface => generated 282 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-unplugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] Creating event network-vif-unplugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-819ea0fa-4ec5-42af-875e-af7d497c4990 req-fd8c72a8-ea56-449b-8df0-45ec501c64cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049255 Nov 28 20:23:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 222/666] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] Creating event network-changed:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d21a67b5-2204-466d-af9e-18dee6532abf req-cf6bcc69-02ea-4afe-9cd1-d67a9a146279 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073833 Nov 28 20:23:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 223/667] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:23:56 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-75d76905-3c4f-43af-a6ba-7281d73dabb1 req-3928dd06-a517-48fa-8bad-bb5a7429fa25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045484 Nov 28 20:23:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 223/668] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] Creating event network-changed:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-c78732a8-66df-4785-8ef8-5611ab4de37b req-e9918a5f-f998-4e67-90f1-49713263145b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066639 Nov 28 20:23:57 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 223/669] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:58 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}, {"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:23:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6ad835cd-8b5b-4eb6-925d-4445daab528b req-c1ee5ada-bb91-42c3-ae56-643b77f2224f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054974 Nov 28 20:23:58 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 224/670] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:23:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}, {"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:23:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:23:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:23:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:23:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:23:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:23:59 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] Instance 93392110-c3c3-44ff-a046-2f11608106c3 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=65586) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5994}} Nov 28 20:23:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-d60db0d5-2fab-4994-b22f-f7263474dc51 req-177049aa-f883-48c9-8154-c42dba316dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042747 Nov 28 20:23:59 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 224/671] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=34 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:24:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-de1b67ff-c5d0-4d46-8b96-8c39865a6484 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 204 len: 0 microversion: 2.1 time: 0.161191 Nov 28 20:24:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 224/672] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:24:11 2023] DELETE /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:11 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ffae0c69e0c40e0917cf412e7757616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8895df748b4644e9bad362ea318e04c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:11 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bafb2abd-b4ab-4879-b4ee-8811479fa2fe tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 200 len: 1713 microversion: 2.1 time: 0.300358 Nov 28 20:24:11 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 225/673] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:11 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 1713 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-unplugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] Creating event network-vif-unplugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:24:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-5ca6fd9d-86b0-4da7-ad4b-ea4930c0f5be req-a2e7a7b9-67cb-425d-8750-b95d332f8d4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072084 Nov 28 20:24:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 225/674] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1af2c267-0b3b-4f04-a35a-f241cab89d87 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c/action" status: 202 len: 0 microversion: 2.87 time: 0.150690 Nov 28 20:24:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 225/675] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:24:12 2023] POST /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:12 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d05d0e4f-3b25-41a4-9bed-a01a79a3d225 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1762 microversion: 2.87 time: 0.275820 Nov 28 20:24:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 226/676] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:24:12 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1762 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:24:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] Creating event network-vif-unplugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:24:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-9f5791b6-3d4e-4373-bea1-b1226510804d req-b0b534d7-eeea-4340-ac74-d88b8b3ecd48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032421 Nov 28 20:24:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 226/677] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-deleted", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] Creating event network-vif-deleted:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:24:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-58b17bb0-b198-4d67-b157-74bf632f06c5 req-5f6c51c2-1f77-4856-8bb6-280ffe131633 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044485 Nov 28 20:24:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 226/678] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40ac5386-d43f-443c-ac15-186b368728f8", "name": "network-vif-plugged", "status": "completed", "tag": "38a389ab-f2f2-413a-85e1-b40415fc156c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] Creating event network-vif-plugged:38a389ab-f2f2-413a-85e1-b40415fc156c for instance 40ac5386-d43f-443c-ac15-186b368728f8 on user Nov 28 20:24:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-a6b103db-3230-466e-a3ce-dc879c76be16 req-00744936-8934-4f09-87e8-00b6bd78790b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029809 Nov 28 20:24:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 227/679] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:24:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cde9e5b9-3cef-4310-b360-192d228c3c8b req-0d85dfc9-c211-41b6-8f5a-07369715f714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034396 Nov 28 20:24:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 227/680] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}, {"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:24:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:24:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e612ca41-b6b5-410c-bc8b-8a17a3785c51 req-c0b39085-9bd1-4988-b6d8-930c360f5ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031601 Nov 28 20:24:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 227/681] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=14 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] HTTP exception thrown: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. Nov 28 20:24:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 404 to user: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:24:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3245156b-beab-4923-9f27-f6152eb864ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 404 len: 111 microversion: 2.1 time: 0.148006 Nov 28 20:24:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 228/682] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:25 2023] GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-caf66cc9-ff60-40d9-857a-8eead6f7654f tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1491 microversion: 2.1 time: 0.264246 Nov 28 20:24:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 228/683] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:25 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1491 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:24:26 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e923e24d-9125-4b89-9391-5b9f415a2e45 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1549 microversion: 2.1 time: 0.237670 Nov 28 20:24:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 228/684] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:25 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1549 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:26 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lazy-loading 'services' on Instance uuid 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:24:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7b615053-9177-4ee7-a34f-0c2f85c09c15 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments/e5a18686-4ce1-48a9-8657-5d9ca9a6f618" status: 202 len: 0 microversion: 2.1 time: 0.183983 Nov 28 20:24:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 229/685] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:24:26 2023] DELETE /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments/e5a18686-4ce1-48a9-8657-5d9ca9a6f618 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b4d386e3-8dab-4dd1-bef5-031975189fb6 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056107 Nov 28 20:24:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 229/686] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:24:26 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:31 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-94a7443d-02ba-4b45-a3d5-44ababe6349e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1557 microversion: 2.1 time: 0.279115 Nov 28 20:24:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 229/687] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:31 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1557 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4baee6e6-4049-4a28-96ea-c0a5b910a8dc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202020 Nov 28 20:24:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 230/688] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:24:35 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 25 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:24:37 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:37 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7a3092bc-eefb-4c17-b3a9-c2520357bca8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: .version_select at 0x7f9e643383a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-149674416", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOwoMBR4cnJDatR+jEGAoE1++DF00x1L3tAHFh+2yRDgkQBY4IPkD5ygZ01Zy4k93InMKpeftJSTa2JLsnlu1pFbf2YVD4gZrxRSbUCScLWZKcNGiSbU5NXz8hrSEW1+w=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:37 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-7a3092bc-eefb-4c17-b3a9-c2520357bca8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for project 4fb173b085164da1b53412e2948fbdfe. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:24:37 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-7a3092bc-eefb-4c17-b3a9-c2520357bca8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for user 6722115f609e44ccad60d00c89a04ddb and project 4fb173b085164da1b53412e2948fbdfe. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:24:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7a3092bc-eefb-4c17-b3a9-c2520357bca8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051474 Nov 28 20:24:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 230/689] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:24:37 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1371290012", "imageRef": "b593e02e-c19a-4aca-a243-304aa450f095", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-149674416", "networks": [{"uuid": "e39d0149-8def-41f4-88a9-2b447dd62342"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:37 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] validate_networks() for [('e39d0149-8def-41f4-88a9-2b447dd62342', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for project 4fb173b085164da1b53412e2948fbdfe. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for user 6722115f609e44ccad60d00c89a04ddb and project 4fb173b085164da1b53412e2948fbdfe. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:24:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b593e02e-c19a-4aca-a243-304aa450f095',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:24:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0fc99830-1f05-4aad-b2d8-33e10567cad8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.505399 Nov 28 20:24:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 230/690] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:24:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:24:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cbc6c047-b8b5-4f2b-8631-5c9481b2bdd2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-cbc6c047-b8b5-4f2b-8631-5c9481b2bdd2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:38 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-cbc6c047-b8b5-4f2b-8631-5c9481b2bdd2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:24:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cbc6c047-b8b5-4f2b-8631-5c9481b2bdd2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1250 microversion: 2.1 time: 0.063033 Nov 28 20:24:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 231/691] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:24:38 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1250 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1962081-a05e-49fb-a05e-9c37e208e4ff"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6605cf99-8205-4ac0-aa90-f960f0018f2b tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312955 Nov 28 20:24:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 231/692] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:24:38 2023] POST /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] Creating event network-changed:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:24:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-aeea475d-929d-47e1-a38f-caba47638cf2 req-87fa940c-d68f-4cce-bf74-cc3c8f5818a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036891 Nov 28 20:24:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 231/693] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:24:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e35d52fe-4e9b-4394-be1f-2bbbe3ade875 req-9591a62a-e88a-41e0-a5e1-7dec71cba720 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123180 Nov 28 20:24:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 232/694] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:24:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:24:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a99e4be5-bd2f-4cb8-9d35-6a8e7bec4e44 req-adc76fd5-6d28-4c19-80c3-c3d2961b74c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044891 Nov 28 20:24:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 232/695] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:49 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lazy-loading 'services' on Instance uuid 86c31e96-70cf-45fd-9578-194706af2ad0 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:24:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0c2b3703-e4c5-407b-9cea-d39fdfc7a086 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/c1962081-a05e-49fb-a05e-9c37e208e4ff" status: 202 len: 0 microversion: 2.1 time: 0.176987 Nov 28 20:24:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 232/696] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:24:49 2023] DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments/c1962081-a05e-49fb-a05e-9c37e208e4ff => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:24:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:24:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-32da93ab-6105-4942-9c3e-8d64f9449e19 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063283 Nov 28 20:24:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 233/697] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:24:49 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:25:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:01 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:01 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HTTP exception thrown: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. Nov 28 20:25:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Returning 404 to user: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:25:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-42e8b75a-b586-4260-b6e1-1a9015d30059 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 404 len: 111 microversion: 2.1 time: 0.040371 Nov 28 20:25:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 233/698] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:01 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HTTP exception thrown: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. Nov 28 20:25:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Returning 404 to user: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:25:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-055c22a4-1345-4db8-8ae3-3f85aecbb13b tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036753 Nov 28 20:25:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 233/699] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:25:02 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=14 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:03 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:03 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:03 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-481b914b-dbbc-4253-901c-44623f5e2bff tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1768 microversion: 2.87 time: 0.237824 Nov 28 20:25:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 234/700] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:25:02 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1768 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HTTP exception thrown: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. Nov 28 20:25:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Returning 404 to user: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:25:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-17a268c2-8b5a-42e1-af20-d803c401b7ff tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 404 len: 111 microversion: 2.1 time: 0.025225 Nov 28 20:25:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 234/701] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:25:05 2023] DELETE /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] [instance: 40ac5386-d43f-443c-ac15-186b368728f8] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] HTTP exception thrown: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. Nov 28 20:25:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Returning 404 to user: Instance 40ac5386-d43f-443c-ac15-186b368728f8 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:25:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-83faa1f6-813f-4557-9e84-6836494148f9 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8" status: 404 len: 111 microversion: 2.1 time: 0.029132 Nov 28 20:25:05 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 234/702] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:05 2023] GET /compute/v2.1/servers/40ac5386-d43f-443c-ac15-186b368728f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:25:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2c5f7e4d-d41e-47d0-8b62-376f6d1d2f40 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] Calling method '.version_select at 0x7f9e64499870>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2c5f7e4d-d41e-47d0-8b62-376f6d1d2f40 tempest-ServerActionsTestOtherB-1446981498 tempest-ServerActionsTestOtherB-1446981498-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179232993" status: 202 len: 0 microversion: 2.1 time: 0.024742 Nov 28 20:25:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 235/703] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:25:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1179232993 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9784b563-bd33-4491-8e94-0c1d1173331f tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045497 Nov 28 20:25:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 235/704] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:25:16 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4456fa82-b58c-4b6e-9bec-e89d7917af45 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '.version_select at 0x7f9e649535b0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4456fa82-b58c-4b6e-9bec-e89d7917af45 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308" status: 204 len: 0 microversion: 2.1 time: 0.247013 Nov 28 20:25:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 235/705] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:17 2023] DELETE /compute/v2.1/images/f77204ba-f257-4f61-8ad9-2a67f408d308 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:25:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-62b24703-4d0e-4516-b73d-3863f85aebda tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 204 len: 0 microversion: 2.1 time: 0.122514 Nov 28 20:25:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 236/706] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:25:17 2023] DELETE /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4045806241134f5580140b5049e33228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7077abda0e884a0883f39e48e56af27e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3c2add71-17ff-4298-b6e0-5a59bfe3799b tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 200 len: 1673 microversion: 2.1 time: 0.254668 Nov 28 20:25:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 236/707] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:17 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 1673 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-unplugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] Creating event network-vif-unplugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:25:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b4835930-3018-4da5-8fb0-ab94fee121a7 req-62aab8d9-5107-4eef-97a1-89c2bc400819 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029178 Nov 28 20:25:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 236/708] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:25:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:25:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-deleted", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] Creating event network-vif-deleted:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:25:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-551ff33a-ea2b-4aed-b00b-2478151abc55 req-dfab85a9-aaa8-4692-881b-150935590116 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030713 Nov 28 20:25:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 237/709] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:25:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:25:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc", "name": "network-vif-plugged", "status": "completed", "tag": "1fbed4dc-8f66-4490-88f7-a0c4ae19fde9"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] Creating event network-vif-plugged:1fbed4dc-8f66-4490-88f7-a0c4ae19fde9 for instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc on user Nov 28 20:25:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1c6b45f5-34d2-41d3-bb87-398d99400863 req-9cc71d2c-dc04-4560-b312-0ee5380a7ce0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Nov 28 20:25:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 237/710] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:25:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] Creating event network-changed:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:25:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-2aee2350-e82a-4b7c-8c22-3cf53435ad75 req-994c0cf7-dd25-43f2-89c3-e511abfe68d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032357 Nov 28 20:25:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 238/711] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:25:27 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:25:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-13168484-694b-4481-92c7-fd6d4737a298 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 204 len: 0 microversion: 2.1 time: 0.126791 Nov 28 20:25:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 237/712] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:25:27 2023] DELETE /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca4e178401f940438a766a048076af93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bcf01c7a7d24806a2ffe82ec75c8a51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-798b4e9c-74a0-4875-90a8-dc06fd1be29c tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 200 len: 1555 microversion: 2.1 time: 0.815546 Nov 28 20:25:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 238/713] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:27 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 1555 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:28 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b6e5dbaf-c220-4bc4-9fa4-42c1608ecdbb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1534 microversion: 2.1 time: 0.240869 Nov 28 20:25:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 239/714] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:28 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1534 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:25:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ff9b0fa3-6ac2-4f85-932a-3b67711501ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-34481185", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "4e3ba5c6-3b34-431f-99dc-a9f9e8f43b8f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b45a9bdc-c522-435b-8532-28ec9780b49a"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-ff9b0fa3-6ac2-4f85-932a-3b67711501ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] HTTP exception thrown: Block Device 4e3ba5c6-3b34-431f-99dc-a9f9e8f43b8f is not bootable. Nov 28 20:25:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ff9b0fa3-6ac2-4f85-932a-3b67711501ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 400 to user: Block Device 4e3ba5c6-3b34-431f-99dc-a9f9e8f43b8f is not bootable. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:25:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ff9b0fa3-6ac2-4f85-932a-3b67711501ee tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.074154 Nov 28 20:25:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 238/715] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:25:28 2023] POST /compute/v2.1/servers => generated 110 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:29 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2d10ab57-0f3c-4214-b3ce-a71f3df07d05 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1491 microversion: 2.1 time: 0.285182 Nov 28 20:25:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 239/716] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:28 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1491 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:25:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-unplugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-plugged", "status": "completed", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}, {"server_uuid": "f95d416b-d3b7-4b16-adc7-83a06088e167", "name": "network-vif-deleted", "tag": "4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Creating event network-vif-unplugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:25:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Creating event network-vif-plugged:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:25:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] Creating event network-vif-deleted:4f3e6a23-8c5d-4699-8ad8-e8ed1cf1e88f for instance f95d416b-d3b7-4b16-adc7-83a06088e167 on user Nov 28 20:25:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-54e2bf2c-c2c1-4da9-8a9d-41a56cdb86cc req-4c5a5e20-7e4a-45f5-93bc-d54e4edaf613 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.032221 Nov 28 20:25:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 240/717] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5e29d7e7-5a56-4c6c-a390-9b0f6f3dd61a tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action" status: 204 len: 0 microversion: 2.1 time: 0.086014 Nov 28 20:25:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 239/718] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:25:31 2023] POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:32 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:25:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d967d71f-7d0a-49da-8401-d04d4b5cc2a0 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1557 microversion: 2.1 time: 0.421094 Nov 28 20:25:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 240/719] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:25:31 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1557 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:25:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:25:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:25:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:25:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-29255f48-8cee-4aac-8ec9-df843ff49e26 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047944 Nov 28 20:25:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 241/720] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:25:39 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:26:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-364538158", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:03 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] validate_networks() for [('60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for user 007af37c9a914cd5863e486c041701be and project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:26:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:26:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8aff91c0-e070-450d-a0f9-60292e5120bc tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.687666 Nov 28 20:26:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 240/721] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:26:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=32 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:04 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8aa3e87b-9657-4b72-b2ec-9f35540c2154 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 200 len: 1394 microversion: 2.87 time: 0.077976 Nov 28 20:26:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 241/722] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:26:04 2023] GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 1394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:26:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] Creating event network-changed:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:26:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-0cb3807f-c433-485c-812a-35c21c4990b7 req-c883d17f-50e0-4afa-ac87-4aea3bf27b81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036792 Nov 28 20:26:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 242/723] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] [instance: 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] HTTP exception thrown: Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc could not be found. Nov 28 20:26:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Returning 404 to user: Instance 1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:26:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6400d88b-faf3-47ee-9482-ad15623dded4 tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc" status: 404 len: 111 microversion: 2.1 time: 0.030761 Nov 28 20:26:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 241/724] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:07 2023] GET /compute/v2.1/servers/1af8be0e-6c6a-44b5-bad1-6f0cf9e8b5dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:26:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2e86940c-0ed5-4ebf-9167-e0c27d37088a tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] Calling method '.version_select at 0x7f9e64af44c0>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2e86940c-0ed5-4ebf-9167-e0c27d37088a tempest-ServerStableDeviceRescueTest-45095974 tempest-ServerStableDeviceRescueTest-45095974-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-794763884" status: 202 len: 0 microversion: 2.1 time: 0.035607 Nov 28 20:26:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 242/725] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:26:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-794763884 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "name": "network-vif-plugged", "status": "completed", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:08 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:26:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] Creating event network-vif-plugged:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:26:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b1850d9c-e045-4c25-9986-611784569fd5 req-30667cca-38fe-44fa-9f6c-b2c025c864fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029737 Nov 28 20:26:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 242/726] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-85fece4e-6de9-4e69-ad41-320d06a7b426 tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 204 len: 0 microversion: 2.1 time: 0.145561 Nov 28 20:26:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 243/727] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:26:08 2023] DELETE /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "name": "network-vif-unplugged", "status": "completed", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] Creating event network-vif-unplugged:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:26:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7e109a59-e72a-41b5-80dd-7fc1795e67b8 req-88443627-19e4-4d54-8be6-79fd9ff5ae80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033043 Nov 28 20:26:09 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 243/728] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '270de3ab19964431afa20c767af7b23c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee4056e8f34a4e8da54592d28d7a75a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0e2d2a16-e03c-42f4-816b-2a0f9a74d8ac tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 200 len: 1716 microversion: 2.1 time: 0.373626 Nov 28 20:26:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 243/729] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:08 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 1716 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "name": "network-vif-deleted", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] Creating event network-vif-deleted:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:26:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7aa050e6-5af4-41ac-8c0f-f4b4bd5e23ce req-76343e9e-f0ff-46ae-93ae-c463765115cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036526 Nov 28 20:26:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 244/730] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "name": "network-vif-plugged", "status": "completed", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] Creating event network-vif-plugged:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:26:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a447953e-691f-45b5-a5e4-dbf12a036742 req-5aedb900-da61-43a0-9450-202701cd8d53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044532 Nov 28 20:26:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 244/731] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86c31e96-70cf-45fd-9578-194706af2ad0", "name": "network-vif-plugged", "status": "completed", "tag": "524df3be-b94b-462e-89c0-57ffa9878bd1"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] Creating event network-vif-plugged:524df3be-b94b-462e-89c0-57ffa9878bd1 for instance 86c31e96-70cf-45fd-9578-194706af2ad0 on user Nov 28 20:26:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-5335eb8e-7073-448f-bc54-94742bc880bb req-35175bd3-8ffb-4c3f-b901-65629cbc4d7a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028846 Nov 28 20:26:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 244/732] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] [instance: f95d416b-d3b7-4b16-adc7-83a06088e167] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] HTTP exception thrown: Instance f95d416b-d3b7-4b16-adc7-83a06088e167 could not be found. Nov 28 20:26:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Returning 404 to user: Instance f95d416b-d3b7-4b16-adc7-83a06088e167 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:26:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1aa62196-1574-432a-8665-e393a780ab37 tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167" status: 404 len: 111 microversion: 2.1 time: 0.029204 Nov 28 20:26:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 245/733] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:18 2023] GET /compute/v2.1/servers/f95d416b-d3b7-4b16-adc7-83a06088e167 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:26:18 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:18 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-67e2dc27-9013-46b9-b8c9-d729ac59df8b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] Calling method '.version_select at 0x7f9e64417910>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-67e2dc27-9013-46b9-b8c9-d729ac59df8b tempest-TestShelveInstance-1960669737 tempest-TestShelveInstance-1960669737-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752726007" status: 202 len: 0 microversion: 2.1 time: 0.026801 Nov 28 20:26:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 245/734] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Nov 28 20:26:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752726007 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:22 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:22 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9bdc2d0d-2360-4900-a9a9-fc7483739824 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1549 microversion: 2.1 time: 0.401188 Nov 28 20:26:22 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 245/735] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:22 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1549 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:23 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-96153bf1-b93f-49ab-a657-8cba83c15ce3 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: .version_select at 0x7f9e6455ec20>, body: {"keypair": {"name": "tempest-keypair-1076987994", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3XwsjqlLJC+H5W8+kliU+liUVxsmiGlirVM1hB3Xvq2TAMksvSwoTdDPqxJDLnMy/epsE7znWc/yERpeFqyVO3BqmqmL465Jtof0GPEtberkTrsDvfTVDra8QzBI4sQ=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:23 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-96153bf1-b93f-49ab-a657-8cba83c15ce3 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for project a7d489de217644979c5888d97158a800. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:26:23 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-96153bf1-b93f-49ab-a657-8cba83c15ce3 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for user d653c87883374ab59768ce28b2b9adfc and project a7d489de217644979c5888d97158a800. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:26:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-96153bf1-b93f-49ab-a657-8cba83c15ce3 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159735 Nov 28 20:26:23 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 246/736] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:26:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-599565098", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "0c40204c-6e11-4188-ac50-9e10214d9a08"}], "security_groups": [{"name": "tempest-securitygroup--1220163280"}], "key_name": "tempest-keypair-1076987994", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] validate_networks() for [('0c40204c-6e11-4188-ac50-9e10214d9a08', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for project a7d489de217644979c5888d97158a800. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for user d653c87883374ab59768ce28b2b9adfc and project a7d489de217644979c5888d97158a800. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:26:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:26:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b7377fe5-6f18-4719-b6d2-491dede7ce35 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.751399 Nov 28 20:26:25 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 246/737] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:26:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:26:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-def7672e-3e45-49ba-99ef-68f1e0357e05 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-def7672e-3e45-49ba-99ef-68f1e0357e05 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-def7672e-3e45-49ba-99ef-68f1e0357e05 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-def7672e-3e45-49ba-99ef-68f1e0357e05 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1229 microversion: 2.1 time: 0.066395 Nov 28 20:26:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 246/738] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:25 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1229 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] Creating event network-changed:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:26:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-3b8de463-dc79-41df-9ee0-f3890eb44204 req-760d7ebc-b468-4002-8cc5-207055931402 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035556 Nov 28 20:26:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 247/739] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cf526d28-278c-4d12-b53a-1647efb438d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1534 microversion: 2.1 time: 0.364883 Nov 28 20:26:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 247/740] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:28 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1534 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching by: {'deleted': False, 'project_id': '4fb173b085164da1b53412e2948fbdfe'} {{(pid=65586) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65586]: DEBUG nova.compute.multi_cell_list [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-45cd860f-910d-404f-86e6-940d922ff5cb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.180860 Nov 28 20:26:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 247/741] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 20:26:29 2023] GET /compute/v2.1/servers => generated 341 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:29 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-36752839-912f-4e95-834d-da5bb9a10324 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1534 microversion: 2.1 time: 0.160686 Nov 28 20:26:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 248/742] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:29 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1534 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ed6edb37-b0f2-446c-89c3-bce1e3c2e5a8 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1491 microversion: 2.1 time: 0.213606 Nov 28 20:26:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 248/743] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:29 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1491 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:26:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-19c32b34-6adc-4fd3-886b-32a58a3b805a req-f823b28f-83f8-432b-9691-d0cfac2c849f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043832 Nov 28 20:26:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 248/744] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0e3c161-4228-4fc0-afb9-4de5e6eff658"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-87e81c51-7f2f-41a1-8791-3670f76cc75b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369985 Nov 28 20:26:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 249/745] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:26:32 2023] POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:26:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-9534ff37-c496-4a91-b57e-2516c291d554 req-cd9fa396-4c0d-443f-a518-529fd83bca8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036225 Nov 28 20:26:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 249/746] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=16 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:45 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0350af44-592a-479a-a9a1-a09933a37c32 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1580 microversion: 2.1 time: 0.207902 Nov 28 20:26:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 249/747] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:45 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1580 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] Creating event network-changed:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:26:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7df0e165-5ff9-473a-9def-f4367c8a09bd req-32b1f5b1-eba7-4fa5-86fa-a8d0a8a78b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091243 Nov 28 20:26:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 250/748] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-428951967"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:49 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:49 user devstack@n-api.service[65587]: INFO nova.network.security_group_api [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Adding security group 4101f0b6-01fe-41ff-94a5-950e387ba53c to port f496e45a-10e5-489c-bec3-3788ecad173c Nov 28 20:26:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3c66c522-aa15-4b49-8c08-65c2b3493e69 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action" status: 202 len: 0 microversion: 2.1 time: 0.585882 Nov 28 20:26:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 250/749] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:26:48 2023] POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:26:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] Creating event network-changed:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:26:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-cf0aa3e9-cfca-4716-a68c-c76702f4dff1 req-303e21ac-4116-4793-a474-ebbea2b350ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028032 Nov 28 20:26:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 250/750] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:49 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8b6216dd-14a7-4672-89b4-b90dd41a2e2b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1745 microversion: 2.1 time: 0.263165 Nov 28 20:26:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 251/751] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:49 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1745 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3d9e55e9-69ee-4b01-9250-75b4ebc322ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action" status: 202 len: 0 microversion: 2.1 time: 0.092982 Nov 28 20:26:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 251/752] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:26:53 2023] POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:54 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a804c7a2-378b-45ea-940d-6e91dd6814be tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1747 microversion: 2.1 time: 0.391106 Nov 28 20:26:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 251/753] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:53 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1747 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:54 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:26:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b1f52bc8-3968-4213-9414-7c112ec38726 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 200 len: 1690 microversion: 2.87 time: 0.274832 Nov 28 20:26:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 252/754] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:26:54 2023] GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:26:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-unplugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] Creating event network-vif-unplugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:26:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b761efd0-218c-43c7-a193-7585da1d0590 req-e06f6cdd-8e8e-4b1d-ad6d-a0e559a428d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034536 Nov 28 20:26:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 252/755] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:56 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:26:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1a0a969d-daf1-4503-a6a1-dc32e3881f70 req-0d7c5611-64cc-4863-b4e9-c80f7ff9b8b1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037458 Nov 28 20:26:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 252/756] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:26:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:26:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-b3df331e-8e0d-42d0-a722-56a37a076c65 req-423f0152-b12f-4810-985a-e1c2a3d33626 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044073 Nov 28 20:26:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 253/757] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:26:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] [instance: 86c31e96-70cf-45fd-9578-194706af2ad0] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:26:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] HTTP exception thrown: Instance 86c31e96-70cf-45fd-9578-194706af2ad0 could not be found. Nov 28 20:26:59 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Returning 404 to user: Instance 86c31e96-70cf-45fd-9578-194706af2ad0 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:26:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-81fb715e-c528-44e0-a22e-b19163296c7c tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0" status: 404 len: 111 microversion: 2.1 time: 0.033373 Nov 28 20:26:59 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 253/758] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:26:59 2023] GET /compute/v2.1/servers/86c31e96-70cf-45fd-9578-194706af2ad0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:26:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-525777fe-1923-4f0e-ae3e-6b0822535dbc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] Calling method '.version_select at 0x7f9e64265e10>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:26:59 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-525777fe-1923-4f0e-ae3e-6b0822535dbc tempest-SnapshotDataIntegrityTests-1740984498 tempest-SnapshotDataIntegrityTests-1740984498-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062785846" status: 202 len: 0 microversion: 2.1 time: 0.025561 Nov 28 20:26:59 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 253/759] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:26:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2062785846 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:27:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:27:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:27:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6165bdc1-305b-4fa0-8c3d-1cf129ec5587 req-3303f1c8-12bc-477d-91e7-5ba711cf5964 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095147 Nov 28 20:27:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 254/760] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:27:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:27:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:16 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:27:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-23341783-2dcc-4046-abe8-5f73bb358138 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1536 microversion: 2.1 time: 0.203279 Nov 28 20:27:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 254/761] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:27:15 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1536 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:27:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=16 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:27:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-de4f6b1c-8723-4d6f-8487-5a6742a77c33 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1549 microversion: 2.1 time: 0.482805 Nov 28 20:27:23 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 254/762] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:27:22 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1549 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-abb28987-4a7e-4e8d-80ea-848b75a36439 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action" status: 200 len: 32198 microversion: 2.1 time: 0.221902 Nov 28 20:27:23 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 255/763] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:27:23 2023] POST /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3/action => generated 32198 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:23 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:27:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c67d27de-4480-43cf-b59a-a9967fda9b0b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1539 microversion: 2.1 time: 0.185383 Nov 28 20:27:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:27:23 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1539 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:27:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-292f2984-9eb1-42e3-a6f1-ca549c649d04 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-661810199", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "77b9e284-7155-4207-b748-934c25ce18d0", "destination_type": "local"}, {"source_type": "volume", "uuid": "777979d9-38b0-468d-bcf0-f56be64ebdcd", "destination_type": "invalid"}], "networks": [{"uuid": "b45a9bdc-c522-435b-8532-28ec9780b49a"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:27:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-292f2984-9eb1-42e3-a6f1-ca549c649d04 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:27:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-292f2984-9eb1-42e3-a6f1-ca549c649d04 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.009261 Nov 28 20:27:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 255/765] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:27:32 2023] POST /compute/v2.1/servers => generated 155 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:32 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:27:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-41be5f80-2004-4c3a-84b9-5e7df7b43ade tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1491 microversion: 2.1 time: 0.234939 Nov 28 20:27:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 256/766] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:27:32 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1491 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:44 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:27:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ded25ebe-7483-4c09-9f82-e1d0c4d2d899 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1745 microversion: 2.1 time: 0.226244 Nov 28 20:27:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 256/767] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:27:44 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1694566137"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:27:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:27:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b13e3bbb-4354-43a8-bc15-d6845e2c70d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86/action" status: 202 len: 52 microversion: 2.87 time: 1.020598 Nov 28 20:27:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 256/768] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:27:54 2023] POST /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86/action => generated 52 bytes in 1022 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:01 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:01 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:01 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-85c27f8c-9de6-4c55-9eb2-51f0808a80b3 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 200 len: 1690 microversion: 2.87 time: 0.212923 Nov 28 20:28:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 257/769] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:28:00 2023] GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 1690 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-950c49eb-372e-44f4-8c28-dd41ba9e3a09 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.152089 Nov 28 20:28:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 257/770] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:28:16 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-interface => generated 283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] Creating event network-changed:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:28:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-b5f8ca18-4dc5-4756-a529-979f39111271 req-193029dd-2698-42a1-a297-67f475573d29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091017 Nov 28 20:28:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 257/771] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-aefdefbf-69a8-439c-993a-61270e785021 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/ips" status: 200 len: 105 microversion: 2.1 time: 0.042291 Nov 28 20:28:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 258/772] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:28:17 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/ips => generated 105 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "564f704c-2c1e-45f6-b1a6-ed05d4ee8f15"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:20 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bac6d3ea-9ef8-4f0a-8e30-65ef57653451 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308920 Nov 28 20:28:20 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 258/773] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:28:20 2023] POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments => generated 194 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:23 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:28:24 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c0099dc1-7590-4c3d-90d7-44a1a53fa0c8 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 204 len: 0 microversion: 2.1 time: 0.111871 Nov 28 20:28:24 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 258/774] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:28:23 2023] DELETE /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:24 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b390e318-bf2f-4e20-9dc5-8fd57e5f90b9 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 200 len: 1555 microversion: 2.1 time: 0.257376 Nov 28 20:28:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 259/775] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:28:24 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:28:24 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-unplugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] Creating event network-vif-unplugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:28:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e5bd3867-e36d-4eb5-9c4f-0438db9b1733 req-980197c9-3c00-446e-aa6d-681a100e8736 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034107 Nov 28 20:28:24 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 259/776] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-deleted", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] Creating event network-vif-deleted:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:28:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-be9cf767-d43b-418c-b6c4-dba864424c6f req-0ccb3f68-9d27-4564-82d9-796ec4a6d427 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033508 Nov 28 20:28:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 259/777] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93392110-c3c3-44ff-a046-2f11608106c3", "name": "network-vif-plugged", "status": "completed", "tag": "45eabb36-f147-4900-b1dc-8b48e4141866"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] Creating event network-vif-plugged:45eabb36-f147-4900-b1dc-8b48e4141866 for instance 93392110-c3c3-44ff-a046-2f11608106c3 on user Nov 28 20:28:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-00d69df0-ebd5-4228-8cf6-68eba0f8b185 req-60164c25-d4d4-43d8-8d47-e9c7cdc1fe7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037710 Nov 28 20:28:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 260/778] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Going to try to stop instance {{(pid=65587) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 20:28:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-90cb038c-7139-4085-8db9-9ae72a5db687 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action" status: 202 len: 0 microversion: 2.1 time: 0.189108 Nov 28 20:28:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 260/779] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:28:30 2023] POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-unplugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:30 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b0241f55-16dc-4c92-8db4-686dfc967aee tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1711 microversion: 2.1 time: 0.269246 Nov 28 20:28:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 260/780] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:28:30 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1711 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:28:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] Creating event network-vif-unplugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:28:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-92b0ac43-4902-4a93-af34-2fa4a979802d req-987e3cb0-cea7-4948-8a23-96713771a2e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039423 Nov 28 20:28:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 261/781] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:28:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-0d162917-ea7b-4cd7-8c03-28fedc095859 req-5e531e43-5c36-4121-9c05-f3b4d91c23fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049290 Nov 28 20:28:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 261/782] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] HTTP exception thrown: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. Nov 28 20:28:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 404 to user: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:28:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c96cb52c-e6d5-4456-adf0-4b4ee631f479 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 404 len: 111 microversion: 2.1 time: 0.030385 Nov 28 20:28:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 261/783] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:28:38 2023] DELETE /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 11c97ebd-b684-4c98-9f49-57d25ea0c81b] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] HTTP exception thrown: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. Nov 28 20:28:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 404 to user: Instance 11c97ebd-b684-4c98-9f49-57d25ea0c81b could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:28:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ff777b26-a318-47a5-9116-f66746a82b2b tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b" status: 404 len: 111 microversion: 2.1 time: 0.028032 Nov 28 20:28:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 262/784] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:28:38 2023] GET /compute/v2.1/servers/11c97ebd-b684-4c98-9f49-57d25ea0c81b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:28:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cca8374d-206e-4247-ab68-03bf40c91a49 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 204 len: 0 microversion: 2.1 time: 0.115850 Nov 28 20:28:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 262/785] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:28:38 2023] DELETE /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:39 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24aa8ca42c7342fa91f5eab19b6c0c9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc33efd1bb7f49679e13621e8dd3449a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:28:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-77d4bda9-f8e6-4cf4-884a-4e3b006d4ac4 tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 200 len: 1497 microversion: 2.1 time: 0.220157 Nov 28 20:28:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 262/786] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:28:39 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 1497 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:28:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "name": "network-vif-unplugged", "status": "completed", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] Creating event network-vif-unplugged:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:28:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-fa8cb00b-2230-457b-b734-cb4c04b41bce req-495a2679-aaf2-4181-acea-c58db372b78b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035859 Nov 28 20:28:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 263/787] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "name": "network-vif-deleted", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] Creating event network-vif-deleted:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:28:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-00629d50-59ac-4666-af5c-748ee1caf8bd req-b549d3b0-b127-4b41-b91f-adf52a9befa0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041726 Nov 28 20:28:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 263/788] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6", "name": "network-vif-plugged", "status": "completed", "tag": "585ae662-b7ec-4f43-b5bd-5966bd473eb3"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] Creating event network-vif-plugged:585ae662-b7ec-4f43-b5bd-5966bd473eb3 for instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 on user Nov 28 20:28:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-5c3e5fd3-1860-475a-8ffe-b7434dbe7c21 req-ca281136-4e4e-4da3-ad7f-96c6a8c05517 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033045 Nov 28 20:28:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 263/789] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-428951967"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:45 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:45 user devstack@n-api.service[65585]: INFO nova.network.security_group_api [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Removing security group 4101f0b6-01fe-41ff-94a5-950e387ba53c from port f496e45a-10e5-489c-bec3-3788ecad173c Nov 28 20:28:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bd482d48-2f0d-48fb-a3ec-668237f13d89 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action" status: 202 len: 0 microversion: 2.1 time: 0.551796 Nov 28 20:28:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 264/790] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:28:45 2023] POST /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:28:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] Creating event network-changed:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:28:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a3126a91-0dd5-428c-b9b3-dc088e1ef1d6 req-3cb2fcae-74e7-463b-b1f9-b2c9c318ef3a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045546 Nov 28 20:28:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 264/791] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:28:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] Creating event network-changed:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:28:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-071d6680-c289-4d20-bb4b-a9cc4b64b0a7 req-6d1f0a07-012d-4b62-a278-a98750797cd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029648 Nov 28 20:28:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 264/792] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:46 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'services' on Instance uuid fe1fe030-1a1e-49c9-97e8-6e9840d4908d {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:28:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c2bbdadd-89aa-4185-b5ed-6b2a98cc63d8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments/a0e3c161-4228-4fc0-afb9-4de5e6eff658" status: 202 len: 0 microversion: 2.1 time: 0.155358 Nov 28 20:28:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 265/793] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:28:46 2023] DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments/a0e3c161-4228-4fc0-afb9-4de5e6eff658 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:28:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:28:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6fd5ba6f-64e3-447b-9ddf-2ac84be72bf0 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049828 Nov 28 20:28:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 265/794] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:28:46 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-773181244", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "77b9e284-7155-4207-b748-934c25ce18d0", "destination_type": "volume"}], "networks": [{"uuid": "60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] validate_networks() for [('60ed8ff0-0cd3-44d7-b293-2c83c2e35f5a', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Getting quotas for user 007af37c9a914cd5863e486c041701be and project dd03007966db45f48ae6c22ed6f84871. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:29:01 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:29:01 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-664fc442-93ec-4405-bb2d-79730e4caf17 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.614072 Nov 28 20:29:01 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 265/795] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:29:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:29:01 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=16 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:01 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:01 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:01 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:02 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:02 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:02 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-55871fac-3c56-4f05-9069-b37cc3920c01 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1394 microversion: 2.87 time: 0.085477 Nov 28 20:29:02 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 266/796] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:29:01 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1394 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] Creating event network-changed:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:29:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-77438c33-68ca-4f8e-ab16-05eca3cbcf23 req-8b0b02ff-a8b2-411a-82b6-2734b8a195a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040601 Nov 28 20:29:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 266/797] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HTTP exception thrown: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. Nov 28 20:29:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Returning 404 to user: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:29:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0a87ce69-4182-4cfc-ae87-6a9f0f68023e tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 404 len: 111 microversion: 2.1 time: 0.037525 Nov 28 20:29:14 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 266/798] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:14 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HTTP exception thrown: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. Nov 28 20:29:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Returning 404 to user: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:29:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-01c88cd1-f413-4510-9b78-49839921420c tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 404 len: 111 microversion: 2.1 time: 0.034911 Nov 28 20:29:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 267/799] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:29:14 2023] DELETE /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 93392110-c3c3-44ff-a046-2f11608106c3] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HTTP exception thrown: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. Nov 28 20:29:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Returning 404 to user: Instance 93392110-c3c3-44ff-a046-2f11608106c3 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:29:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-de12b75c-6cbd-46f7-b574-d806c603a023 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3" status: 404 len: 111 microversion: 2.1 time: 0.035135 Nov 28 20:29:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 267/800] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:14 2023] GET /compute/v2.1/servers/93392110-c3c3-44ff-a046-2f11608106c3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:29:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-68a24879-c1a3-4cbc-82d7-64756c0c1f1b tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 204 len: 0 microversion: 2.1 time: 0.110345 Nov 28 20:29:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 267/801] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:29:17 2023] DELETE /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:18 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '098319d33fa243f5a044cf3f3c9f983c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a85595c9e1704e71903d25a65f5b696c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ba4e986b-f6fe-4f22-a9a7-ab16a7d233fa tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 200 len: 1545 microversion: 2.1 time: 0.290296 Nov 28 20:29:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:17 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 1545 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:29:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "name": "network-vif-unplugged", "status": "completed", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] Creating event network-vif-unplugged:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:29:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1552b159-b3e9-437a-88c6-6aab41cbdbf9 req-f327e3e0-b344-4d3c-8531-4ee64cec2fb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032421 Nov 28 20:29:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 268/803] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:29:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-5600cb98-ebb7-4fa7-bef7-1d27bc87225e req-2747c810-13ca-42a6-b61a-bf71bf2ebc96 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031913 Nov 28 20:29:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 268/804] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "name": "network-vif-plugged", "status": "completed", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] Creating event network-vif-plugged:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:29:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5e42164c-2032-471e-82e0-028e0328e065 req-4497e4c6-bf70-4086-844e-6eda225c3db4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027864 Nov 28 20:29:20 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 269/805] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:20 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:20 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1809869a-e45e-4415-b2ab-d06a61f32b18 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1688 microversion: 2.1 time: 0.222772 Nov 28 20:29:20 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 269/806] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:20 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:29:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}, {"server_uuid": "3b0d4ca0-b527-4131-97ff-222cd9ced151", "name": "network-vif-deleted", "tag": "ba72889d-186f-4e53-893b-5509d0882a6a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:29:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] Creating event network-vif-deleted:ba72889d-186f-4e53-893b-5509d0882a6a for instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 on user Nov 28 20:29:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-99d6e7dc-3cf0-487d-9e30-7bef3102d47a req-79ab3137-19fd-48b6-8df4-59d4ef123b83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033866 Nov 28 20:29:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 269/807] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] [instance: 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] HTTP exception thrown: Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 could not be found. Nov 28 20:29:29 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] Returning 404 to user: Instance 20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:29:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-380a8a5d-5336-4546-b631-914385bdc7ec tempest-ServersNegativeTestJSON-146088746 tempest-ServersNegativeTestJSON-146088746-project-member] 10.0.0.210 "GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6" status: 404 len: 111 microversion: 2.1 time: 0.027677 Nov 28 20:29:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 270/808] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:29 2023] GET /compute/v2.1/servers/20c3c4f0-34bb-4cc5-8760-7c2b8acec4f6 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-115a9a8a-71d4-40ae-8903-72ff92cf2524 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.257314 Nov 28 20:29:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 270/809] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:29:36 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments => generated 25 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HTTP exception thrown: Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d is not attached to volume a0e3c161-4228-4fc0-afb9-4de5e6eff658 Nov 28 20:29:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Returning 404 to user: Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d is not attached to volume a0e3c161-4228-4fc0-afb9-4de5e6eff658 {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:29:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-09681533-38e7-4026-8850-a283dbb14beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments/a0e3c161-4228-4fc0-afb9-4de5e6eff658" status: 404 len: 154 microversion: 2.1 time: 0.150161 Nov 28 20:29:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 270/810] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:29:36 2023] DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d/os-volume_attachments/a0e3c161-4228-4fc0-afb9-4de5e6eff658 => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:29:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cc9cd45a-d7e0-47c3-827f-e76525ea0ad2 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: .version_select at 0x7f9e646552d0>, body: {"keypair": {"name": "tempest-keypair-958726701", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7x8JUic8LMH/YQT25GlcwZE6wPOyKaJyvQnNWy47RBRoT/KqLjj+kPL9TeFksxFwkD4J4kVT9wKi4NGz2C12ZF7NEOueU54TasYfa+Zk7dRiUyC3kjH5YG1VpVp8Hw2w=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:39 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-cc9cd45a-d7e0-47c3-827f-e76525ea0ad2 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for project 292cfffce13446c8963785adfb4b9d22. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:29:39 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-cc9cd45a-d7e0-47c3-827f-e76525ea0ad2 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for user 9e21afd3261f4b1a87f7cbb4348fc9fe and project 292cfffce13446c8963785adfb4b9d22. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:29:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cc9cd45a-d7e0-47c3-827f-e76525ea0ad2 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.109304 Nov 28 20:29:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 271/811] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:29:39 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:29:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-29de7390-6636-4638-8d3b-ce32d0613ec1 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 204 len: 0 microversion: 2.1 time: 0.116850 Nov 28 20:29:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 271/812] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:29:40 2023] DELETE /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-unplugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] Creating event network-vif-unplugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:29:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-1b0a139a-aa45-40e3-8853-dac69434d552 req-34aa59d1-4526-4c9a-bb26-9c4739ad1fb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047452 Nov 28 20:29:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 272/813] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:40 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c3e807eb-ac4b-4afa-a404-7f826030c20f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 200 len: 1540 microversion: 2.1 time: 0.380572 Nov 28 20:29:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 271/814] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:29:40 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 1540 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-795547296", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "5889ef34-4490-429e-b51e-1d7d050c1ee7"}], "security_groups": [{"name": "tempest-securitygroup--1330604414"}], "key_name": "tempest-keypair-958726701", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] validate_networks() for [('5889ef34-4490-429e-b51e-1d7d050c1ee7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for project 292cfffce13446c8963785adfb4b9d22. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for user 9e21afd3261f4b1a87f7cbb4348fc9fe and project 292cfffce13446c8963785adfb4b9d22. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:29:41 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:29:41 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6f7a986d-f44f-45c9-bfd3-2a5929b83c4b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.632213 Nov 28 20:29:41 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 272/815] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:29:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Nov 28 20:29:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-deleted", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:41 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] Creating event network-vif-deleted:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:29:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-b6dbcf83-a693-469e-b92c-eddc92e42642 req-3146b67d-c5da-485e-982b-5d6e8d7a7e58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Nov 28 20:29:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 273/816] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:41 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:41 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-746149af-6d23-4255-b62f-0a87a62d8b6b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1272 microversion: 2.20 time: 0.077011 Nov 28 20:29:41 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 272/817] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:29:41 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1272 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:29:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe1fe030-1a1e-49c9-97e8-6e9840d4908d", "name": "network-vif-plugged", "status": "completed", "tag": "f496e45a-10e5-489c-bec3-3788ecad173c"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] Creating event network-vif-plugged:f496e45a-10e5-489c-bec3-3788ecad173c for instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d on user Nov 28 20:29:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-37fcfac9-5518-49df-9f71-9d4a7bb62ef6 req-7db98625-f1de-4ab3-9e9d-5f64ed3c561e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Nov 28 20:29:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 273/818] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] Creating event network-changed:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:29:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ba708d38-7241-479e-8aee-accfb2ef2239 req-2e0388a0-26ab-4734-bfb2-0854e3fea6c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027704 Nov 28 20:29:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 274/819] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:29:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-52cbf22e-b0a5-458c-a947-79d30b838ef5 req-292b02bc-cc4a-47c4-8908-10f159e30f62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033656 Nov 28 20:29:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 273/820] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:29:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:29:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-f60f5a0e-56fb-4964-a558-d1d29c8a2599 req-271f44a0-4ae7-422f-99b6-1b8c1b0564e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048313 Nov 28 20:29:48 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 274/821] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:29:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:52 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:29:52 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9e7b01f7-9f07-4aac-8ddd-123844ea9a96 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1768 microversion: 2.87 time: 0.212375 Nov 28 20:29:52 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 275/822] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:29:52 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1768 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=14 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] [instance: 3b0d4ca0-b527-4131-97ff-222cd9ced151] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] HTTP exception thrown: Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 could not be found. Nov 28 20:30:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Returning 404 to user: Instance 3b0d4ca0-b527-4131-97ff-222cd9ced151 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:30:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6ba9b68e-8078-4ddb-8e12-5dcd933b9491 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151" status: 404 len: 111 microversion: 2.1 time: 0.033233 Nov 28 20:30:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 274/823] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:08 2023] GET /compute/v2.1/servers/3b0d4ca0-b527-4131-97ff-222cd9ced151 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:30:08 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:08 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7c4a14f2-b5b4-4305-8da8-7bdeb1be5a22 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] Calling method '.version_select at 0x7f9e64243eb0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:08 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7c4a14f2-b5b4-4305-8da8-7bdeb1be5a22 tempest-ServerActionsTestOtherA-390918760 tempest-ServerActionsTestOtherA-390918760-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344088806" status: 202 len: 0 microversion: 2.1 time: 0.035696 Nov 28 20:30:08 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 275/824] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:30:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344088806 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:30:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2038069783", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:17 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] validate_networks() for [('05832c98-5094-434e-8832-8d7b10329513', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for user 634123644067453a92f4d43da0b28fa7 and project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:30:18 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:30:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-430ea88f-5517-4738-934e-2d7376364930 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.701233 Nov 28 20:30:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 276/825] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:30:17 2023] POST /compute/v2.1/servers => generated 381 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:30:18 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c160eb7c-889c-43cd-804a-bb2b9f0414f8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:18 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c160eb7c-889c-43cd-804a-bb2b9f0414f8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:18 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:18 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:18 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-c160eb7c-889c-43cd-804a-bb2b9f0414f8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:18 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c160eb7c-889c-43cd-804a-bb2b9f0414f8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1214 microversion: 2.1 time: 0.086814 Nov 28 20:30:18 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 275/826] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:18 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1606228576", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] validate_networks() for [('05832c98-5094-434e-8832-8d7b10329513', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for user 634123644067453a92f4d43da0b28fa7 and project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:30:18 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:30:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b5539718-1905-436d-83ca-380888d86981 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.657853 Nov 28 20:30:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 276/827] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:30:18 2023] POST /compute/v2.1/servers => generated 381 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:30:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3014e83b-2854-4881-b930-870736b3d731 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:19 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3014e83b-2854-4881-b930-870736b3d731 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:19 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3014e83b-2854-4881-b930-870736b3d731 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3014e83b-2854-4881-b930-870736b3d731 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 200 len: 1214 microversion: 2.1 time: 0.073239 Nov 28 20:30:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 277/828] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:19 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:30:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] Creating event network-changed:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:30:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-59fbcfb9-4a68-4552-b98f-e4cf3290b204 req-817dfd00-9f29-4f6d-82e0-4410633383fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034223 Nov 28 20:30:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 276/829] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:21 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Going to try to start instance {{(pid=65587) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 20:30:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d50e1678-bfd3-4a38-ad41-c6167ad295e2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action" status: 202 len: 0 microversion: 2.1 time: 0.103623 Nov 28 20:30:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 277/830] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:30:21 2023] POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:21 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cec1c946-e4af-4b83-9d71-62003f68e722 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1697 microversion: 2.1 time: 0.199939 Nov 28 20:30:21 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 278/831] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:21 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:30:22 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:22 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] Creating event network-changed:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:30:22 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-e689fecd-3e81-490f-8b06-5601ca85256e req-4801d6ec-49cb-4595-88dc-64ace36f1651 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035553 Nov 28 20:30:22 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 277/832] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:24 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:30:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:30:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1c42f541-5a8e-4963-bf4a-cebfc434284c req-e7ab00d1-a560-49c5-8035-1680087d88ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041154 Nov 28 20:30:24 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 278/833] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:30:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-8791842a-b442-4b1a-bf15-929cd4a81576 req-68c7dfbd-813a-4d80-ae6d-9460521f525d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029250 Nov 28 20:30:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 279/834] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:30:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-989c9904-4c10-4ad4-8778-e31d9c8f4177 req-306a3d04-8eca-49e7-b663-d6d8c48412d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049516 Nov 28 20:30:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 278/835] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:30:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1245ddf2-82bd-4331-8926-43429239f7de req-b4a017f2-8848-49d3-8299-1d38be6cf8cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050558 Nov 28 20:30:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 279/836] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:30:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-fbd6f3ea-48f3-476b-bf7b-02bf9ca1ab5d req-02abaaff-5c62-4a64-95f4-39c765109c06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044326 Nov 28 20:30:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 280/837] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: fe1fe030-1a1e-49c9-97e8-6e9840d4908d] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HTTP exception thrown: Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d could not be found. Nov 28 20:30:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Returning 404 to user: Instance fe1fe030-1a1e-49c9-97e8-6e9840d4908d could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:30:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ac9aa8e8-fa4c-43c3-a714-ec544a65efae tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d" status: 404 len: 111 microversion: 2.1 time: 0.043983 Nov 28 20:30:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 279/838] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:30 2023] GET /compute/v2.1/servers/fe1fe030-1a1e-49c9-97e8-6e9840d4908d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:30:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a13dcf19-7b6f-47fa-b615-814bf618be80 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '.version_select at 0x7f9e6475edd0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a13dcf19-7b6f-47fa-b615-814bf618be80 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-149674416" status: 202 len: 0 microversion: 2.1 time: 0.032628 Nov 28 20:30:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 280/839] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 28 20:30:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-149674416 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:32 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:32 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:32 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-67ffd18f-c50a-48a0-a7ee-329fc909fea0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1584 microversion: 2.20 time: 0.378305 Nov 28 20:30:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 281/840] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:30:31 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1584 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:30:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-88caa211-7168-4371-a332-ee598483dcfc tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: .version_select at 0x7f9e64267130>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-661508500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEipdzNZLqCPxCJq60u8xUyzkYMqPIO+X9JodtuRNDPqyX9NiH86q4PyHv85XM1J/imVlNMYd4EKsnbTlYoelp/NoQSXOcmQyHMjfmkcvsc+d7/aGGUQrHbku7H28CUfWA=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:34 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-88caa211-7168-4371-a332-ee598483dcfc tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for project 4fb173b085164da1b53412e2948fbdfe. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:30:34 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-88caa211-7168-4371-a332-ee598483dcfc tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for user 6722115f609e44ccad60d00c89a04ddb and project 4fb173b085164da1b53412e2948fbdfe. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:30:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-88caa211-7168-4371-a332-ee598483dcfc tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.048503 Nov 28 20:30:34 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 280/841] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:30:34 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1665088042", "imageRef": "06d47545-e88b-4137-81e4-ef6283307ebb", "flavorRef": "1", "key_name": "tempest-TestMinimumBasicScenario-661508500", "networks": [{"uuid": "e39d0149-8def-41f4-88a9-2b447dd62342"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] validate_networks() for [('e39d0149-8def-41f4-88a9-2b447dd62342', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for project 4fb173b085164da1b53412e2948fbdfe. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Getting quotas for user 6722115f609e44ccad60d00c89a04ddb and project 4fb173b085164da1b53412e2948fbdfe. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:30:34 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='06d47545-e88b-4137-81e4-ef6283307ebb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:30:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0db69001-e5b0-44be-a0cb-e3aec01b2f74 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.539520 Nov 28 20:30:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 281/842] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:30:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 541 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Nov 28 20:30:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a62f0009-dc26-4641-a1f9-be197592dfa6 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a62f0009-dc26-4641-a1f9-be197592dfa6 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:34 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-a62f0009-dc26-4641-a1f9-be197592dfa6 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a62f0009-dc26-4641-a1f9-be197592dfa6 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1250 microversion: 2.1 time: 0.069651 Nov 28 20:30:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 282/843] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:30:34 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1250 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:30:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] Creating event network-changed:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:30:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-526ce5f1-1645-4331-9038-7994a0bcf02e req-8f6d0324-8f68-439c-9f63-38f5fa73cebf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036172 Nov 28 20:30:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 281/844] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:30:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b5fd0add-2f9f-463a-a9a0-1fb3ebbb6836 req-8d2fe6ed-10d4-46fb-9cec-e76db1351df0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061511 Nov 28 20:30:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 282/845] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:30:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7a4cfa01-a47c-4d6f-9fc5-621d633bd916 req-068303d5-3cce-4dd4-8677-091188ec95db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033973 Nov 28 20:30:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 283/846] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "3ce3dfcc-9cca-4f66-bc88-7957a3302000"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:52 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lazy-loading 'flavor' on Instance uuid 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:30:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9097a559-724a-452b-b1e1-e7a907e912d4 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/action" status: 200 len: 29 microversion: 2.87 time: 0.462464 Nov 28 20:30:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 282/847] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:30:52 2023] POST /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/action => generated 29 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:53 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:30:53 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5f20bd64-b261-4505-8670-571e1ff1e688 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1774 microversion: 2.87 time: 0.412145 Nov 28 20:30:53 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 283/848] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:30:53 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1774 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=20 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-unplugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] Creating event network-vif-unplugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:30:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-55915a42-3a65-43bd-b7ec-815a38e0d690 req-54f91597-194a-4a91-9525-079720597361 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035864 Nov 28 20:30:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 284/849] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:56 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:56 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:30:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3e16da95-0643-4985-8ac4-5aa99039fac4 req-b7cff9cc-3dac-497a-a93c-cf2eed3e9f33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100759 Nov 28 20:30:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 283/850] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:30:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:30:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:30:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:30:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:30:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:30:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-618ef3e7-45cb-41da-a183-6935c3b0cd14 req-5b7a1839-20ee-4728-8851-64aa437226bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034939 Nov 28 20:30:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 284/851] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:30:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:31:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-1b782e0a-610e-44ef-aa2e-617967bb2ad1 req-50b5b5f5-cf12-4d4a-b3e0-119f91705c92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036600 Nov 28 20:31:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 285/852] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:31:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:09 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9cd62c4d-84e1-4a1e-a191-4d08e59ae458 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 200 len: 1503 microversion: 2.1 time: 0.328194 Nov 28 20:31:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 284/853] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:31:09 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 1503 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:11 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-df849623-34e0-4135-a4b4-80f643f43799 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1701 microversion: 2.1 time: 0.345184 Nov 28 20:31:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 285/854] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:31:11 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1701 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:25 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ba649c25-318f-4550-b6ef-ce77f25daf99 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1534 microversion: 2.1 time: 0.195980 Nov 28 20:31:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 286/855] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:31:24 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1534 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0f4640e6-12c2-4ce3-b513-762d08c08b67 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.169750 Nov 28 20:31:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 285/856] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:31:32 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-interface => generated 282 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] Creating event network-changed:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:31:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-5c523e16-9832-4cea-8391-08a601e116c8 req-20ec4dcf-2700-4c20-928f-c921bf07acb9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035654 Nov 28 20:31:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 286/857] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:31:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-53099506-ab88-4c34-bed1-2b82c4b51a64 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/ips" status: 200 len: 150 microversion: 2.20 time: 0.038072 Nov 28 20:31:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 287/858] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 20:31:34 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:37 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'flavor' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:31:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2e90ed4d-0b88-4c00-8ed7-8db727942309 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/action" status: 202 len: 0 microversion: 2.20 time: 0.820300 Nov 28 20:31:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 286/859] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:31:37 2023] POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/action => generated 0 bytes in 822 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-unplugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] Creating event network-vif-unplugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:31:38 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-275ec1f4-8eff-4023-a3b9-8feb7edfc14e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1709 microversion: 2.20 time: 0.323699 Nov 28 20:31:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 287/860] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:31:38 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1709 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:31:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-60606b74-9002-4537-9987-d751942e8fdd req-c4f46dab-d44b-4ba2-961e-42e4375ef5ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031497 Nov 28 20:31:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 288/861] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:31:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:31:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-24c8caea-c612-4e64-a85b-c479fc6ca588 req-4ba8bd39-2441-4683-b488-f5cd77d7fa92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034535 Nov 28 20:31:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 287/862] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:31:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:31:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] Creating event network-changed:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:31:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-c242fc2e-a873-4f81-aac8-e8906f3719b8 req-0496527f-00d4-454c-9fcb-ae05c8b64793 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033458 Nov 28 20:31:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 288/863] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:31:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:43 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:31:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2181a473-7234-47eb-8fff-b6d39eb6767e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1754 microversion: 2.87 time: 0.353550 Nov 28 20:31:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 289/864] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:31:43 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1754 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:09 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid def2369e-4d57-482b-aef9-dab7c3a7cb84 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:32:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-95a69d66-6ac3-4718-9cd0-11d880b51a81 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84/action" status: 200 len: 32 microversion: 2.1 time: 0.108130 Nov 28 20:32:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 288/865] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:32:09 2023] POST /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84/action => generated 32 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:10 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9c88ff04-249c-47e2-9532-46a0c667e443 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 200 len: 1509 microversion: 2.1 time: 0.337057 Nov 28 20:32:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 289/866] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:09 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 1509 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-unplugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] Creating event network-vif-unplugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:32:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ac066656-80c8-40be-8c86-a00ca9ceb060 req-5bd2fe55-cd8a-4eed-be61-c8d321cbf8fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032336 Nov 28 20:32:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 290/867] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:12 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'services' on Instance uuid 636a8f00-7685-4c1b-9404-cf16359dd08a {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:32:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9e9d02fe-93b9-493c-b969-b9227c723d7a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments/564f704c-2c1e-45f6-b1a6-ed05d4ee8f15" status: 202 len: 0 microversion: 2.1 time: 0.324676 Nov 28 20:32:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 289/868] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:32:12 2023] DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments/564f704c-2c1e-45f6-b1a6-ed05d4ee8f15 => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:32:12 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:12 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:32:12 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-51023118-5a5a-406f-a7d8-3a8ae0d2f97c req-8686df1b-76c7-4eeb-8301-6166bbeeaccb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035644 Nov 28 20:32:12 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 290/869] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}, {"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:32:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:32:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-7f72102d-2dc7-4c43-9530-ed41a895f1e3 req-76002626-0e4d-4e93-af7c-b231b1411cf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037656 Nov 28 20:32:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 291/870] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:14 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-96b109ef-bb1e-4d66-8473-4f349515efc8 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1534 microversion: 2.1 time: 0.236631 Nov 28 20:32:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 290/871] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:25 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1534 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Searching by: {'deleted': False, 'project_id': '4fb173b085164da1b53412e2948fbdfe'} {{(pid=65587) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65587]: DEBUG nova.compute.multi_cell_list [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65587) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 20:32:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-766e9752-607a-44f8-96cf-e58e6134bdb5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.195397 Nov 28 20:32:25 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 291/872] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 20:32:25 2023] GET /compute/v2.1/servers => generated 341 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:25 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-14cdbee7-baad-42c5-8048-7f7a226f6c06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1534 microversion: 2.1 time: 0.202008 Nov 28 20:32:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 292/873] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:25 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1534 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "851647b5-5c40-45e4-bfa4-8dc829d269f4"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e55a688f-c6f9-4305-8369-7086e686189b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289676 Nov 28 20:32:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 291/874] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:32:28 2023] POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:28 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8633f4e6-4404-4036-9b99-d2f5af029ef3 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1650 microversion: 2.20 time: 0.224073 Nov 28 20:32:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 292/875] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:32:28 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1650 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:32:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Going to try to stop instance {{(pid=65585) force_stop /opt/stack/nova/nova/compute/api.py:2765}} Nov 28 20:32:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-14793024-c7d9-4e9a-b03f-8c3dffc4794d tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action" status: 202 len: 0 microversion: 2.1 time: 0.110920 Nov 28 20:32:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 293/876] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:32:34 2023] POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:35 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0b38f042-9330-4106-a51f-4c0d51d05113 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1665 microversion: 2.1 time: 0.263756 Nov 28 20:32:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 292/877] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:34 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1665 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-unplugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] Creating event network-vif-unplugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:32:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-22882186-eb4a-4a01-ac0e-f53ee637f4b7 req-844c1554-8c7b-425b-a7e6-add7afc000a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128224 Nov 28 20:32:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 293/878] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:32:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-b01879ca-af3d-45e0-bb3d-40f398c483b0 req-6f04cb73-c4aa-4559-9df7-6b34bcc3dc17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030498 Nov 28 20:32:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 294/879] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:38 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4ab12075-b6a4-43be-b1f8-1ff6063f1b93 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1580 microversion: 2.1 time: 0.190354 Nov 28 20:32:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 293/880] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:38 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1580 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:40 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:32:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] Creating event network-changed:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-4d6ba0a5-184b-482d-a88f-81164165b4b7 req-33e13ee7-7a6a-40b1-85df-1fa13c59fbe0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035485 Nov 28 20:32:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 294/881] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1136442279"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:42 user devstack@n-api.service[65585]: INFO nova.network.security_group_api [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Adding security group b2076ef8-e7cb-4c30-86c2-2aa20b9b5303 to port 48a201ba-2910-4d94-b7a9-ac3878402adf Nov 28 20:32:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1a8eaeac-9d47-4be5-bc51-21839c35f5dd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action" status: 202 len: 0 microversion: 2.1 time: 0.591154 Nov 28 20:32:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 295/882] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:32:41 2023] POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:32:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] Creating event network-changed:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-929018f4-7f08-4a52-90a7-5376972ec863 req-e90e3af5-0702-4fc1-a1c0-668dc7df18cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033656 Nov 28 20:32:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 294/883] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:42 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-da93d4b3-df35-44fd-bb84-fe94e794d905 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1746 microversion: 2.1 time: 0.392381 Nov 28 20:32:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 295/884] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:42 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1746 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:43 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:43 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d85f7a61-0b7f-41e1-8881-38547ef21cb2 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action" status: 202 len: 0 microversion: 2.1 time: 0.089587 Nov 28 20:32:43 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 296/885] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:32:43 2023] POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:43 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-23103682-6486-427b-96b0-d989c55ba5c5 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1738 microversion: 2.1 time: 0.229654 Nov 28 20:32:43 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 295/886] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:32:43 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f25ca426-c4ae-4055-affb-fc23c1a80023 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/action" status: 202 len: 0 microversion: 2.87 time: 0.077815 Nov 28 20:32:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 296/887] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:32:44 2023] POST /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:44 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:32:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c51b6115-d102-4653-8f92-2c293259dc3e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1762 microversion: 2.87 time: 0.216619 Nov 28 20:32:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 297/888] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:32:44 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1762 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:32:44 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-unplugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] Creating event network-vif-unplugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:32:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-76fffea7-2b69-4a30-96ca-d97fb8c7896e req-389cf9d1-9a65-4320-95f7-6f33bf50c771 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029133 Nov 28 20:32:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 296/889] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}, {"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-unplugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}, {"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:32:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Creating event network-vif-unplugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-0c650e3d-7412-4fa9-b3fd-2d4e2e854cd6 req-ca5e9aae-4055-425b-8b03-0a55847989a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047367 Nov 28 20:32:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 297/890] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:46 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:32:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}, {"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}, {"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}, {"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:32:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:32:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:32:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:32:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:32:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:32:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:32:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-51f8d79e-bae8-46dc-aa48-87009d6f3940 req-9960e387-6780-4c6f-b266-bcb10b00fba4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.041201 Nov 28 20:32:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 298/891] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:32:48 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=14 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2fcdcf61-d340-4a7c-b7cb-1dd181b7c033 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 200 len: 1489 microversion: 2.1 time: 0.235044 Nov 28 20:33:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 297/892] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:33:00 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 1489 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=14 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:25 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-20d1ceb0-018d-4538-b682-7cf181ae1cbd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1642 microversion: 2.1 time: 0.215643 Nov 28 20:33:25 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:33:25 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1642 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4ee6c09-63e2-482f-bdbd-db3e6b99273d"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=16 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-29dd43b3-16ab-41b0-8195-d708ab94c8aa tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295877 Nov 28 20:33:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 299/894] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 20:33:28 2023] POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:29 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65586) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 20:33:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-493c066d-2ce5-404d-81fa-b91ff908e0d8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/action" status: 202 len: 0 microversion: 2.20 time: 0.135776 Nov 28 20:33:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 298/895] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:33:29 2023] POST /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:29 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ad4a486c-31bc-40ec-bf99-90e119fec0f5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1736 microversion: 2.20 time: 0.227953 Nov 28 20:33:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 299/896] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:33:29 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1736 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:33 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-09b12887-a6d3-4b17-8dc5-87a28ad0636f tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1746 microversion: 2.1 time: 0.236630 Nov 28 20:33:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 300/897] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:33:33 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:34 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:33:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d52017ae-9738-40cc-9407-9541bb8958c7 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1768 microversion: 2.87 time: 0.333227 Nov 28 20:33:34 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 299/898] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:33:34 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1768 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:33:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:33:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] Creating event network-changed:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:33:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-82eafd4e-a52e-454c-b9c9-ab611b99b690 req-5a09e3a6-714e-4124-9b79-08b7d0d61f7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083062 Nov 28 20:33:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 300/899] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:33:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-2d34e498-9b91-4279-8e7f-83e1e03c1376 req-8f38e096-5af3-4007-96a6-c8ab8b66d7b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044843 Nov 28 20:33:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 301/900] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:33:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:33:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:33:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:33:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3292becf-cf1f-4323-98f2-f4edc0c3bc44 req-b50aa479-7c76-436a-ab1d-901eab03e6e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034296 Nov 28 20:33:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 300/901] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:33:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=14 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:00 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d07e325e-4e56-4872-9660-d9c96728a190 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1502 microversion: 2.1 time: 0.254483 Nov 28 20:34:00 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 301/902] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:34:00 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:19 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c1a539ba-d487-46c4-9a4d-cc288fa6a938 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1781 microversion: 2.20 time: 0.209948 Nov 28 20:34:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 302/903] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:34:19 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1781 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:25 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Going to try to start instance {{(pid=65586) start /opt/stack/nova/nova/compute/api.py:2788}} Nov 28 20:34:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f0e58aff-fd82-4913-adea-7ff725cfbf78 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action" status: 202 len: 0 microversion: 2.1 time: 0.115083 Nov 28 20:34:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 301/904] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:34:25 2023] POST /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:26 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-60963794-5443-49b3-a0d9-8374f893c3dc tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1651 microversion: 2.1 time: 0.300886 Nov 28 20:34:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 302/905] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:34:25 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1651 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:34:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:34:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d265075d-bb27-43b5-b692-a4c5c2f923a2 req-4071f852-ca57-4d97-a800-d9cf04aaf586 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030035 Nov 28 20:34:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 303/906] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:34:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-0c2e8d37-ebbc-4097-b291-fc7eaadc3c78 req-55822acd-abe4-477f-8149-9ca0e7cf8149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028328 Nov 28 20:34:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 302/907] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1136442279"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:34 user devstack@n-api.service[65587]: INFO nova.network.security_group_api [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Removing security group b2076ef8-e7cb-4c30-86c2-2aa20b9b5303 from port 48a201ba-2910-4d94-b7a9-ac3878402adf Nov 28 20:34:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-48fd4227-28a6-40e6-bbdd-cc83933e5565 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action" status: 202 len: 0 microversion: 2.1 time: 0.603175 Nov 28 20:34:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 303/908] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:34:34 2023] POST /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:34:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] Creating event network-changed:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:34:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-338671c7-06e9-49a8-be79-fd14089491c9 req-9eaeec9e-96d3-495d-9db6-7b17819ca75e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031952 Nov 28 20:34:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 304/909] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:34:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-493d3eb2-dbc6-400e-8521-802c2007b3b5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 204 len: 0 microversion: 2.87 time: 0.141444 Nov 28 20:34:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 303/910] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:34:34 2023] DELETE /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:34:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2a393529-b0a1-41f4-a95f-f1eb0e719c2c tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 200 len: 1774 microversion: 2.87 time: 0.393884 Nov 28 20:34:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 304/911] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:34:35 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 1774 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:34:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-unplugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] Creating event network-vif-unplugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:34:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d8f5ba17-bc32-4437-aeae-573d7dbe24fd req-4d0a22f4-7fa3-413c-bd64-5542a46d5245 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107141 Nov 28 20:34:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 305/912] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:36 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lazy-loading 'services' on Instance uuid 136d54f3-eb9a-46fc-8b5f-318b68500804 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:34:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-deleted", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8fac3387-59f2-460c-8897-de7b5a6c2604 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments/851647b5-5c40-45e4-bfa4-8dc829d269f4" status: 202 len: 0 microversion: 2.1 time: 0.383977 Nov 28 20:34:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] Creating event network-vif-deleted:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:34:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 304/913] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:34:36 2023] DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments/851647b5-5c40-45e4-bfa4-8dc829d269f4 => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:34:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1fc488bd-f31a-4e5f-8415-ced14c41dc5c req-47290e99-ac61-4505-92fa-8e9cd776d6d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049616 Nov 28 20:34:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 305/914] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-98d27364-8b9c-4e60-9193-5780d53e483b tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184963 Nov 28 20:34:36 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 306/915] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:34:36 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:34:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867", "name": "network-vif-plugged", "status": "completed", "tag": "aded16b1-1b80-4e18-ab01-ea36010cc6ff"}, {"name": "network-changed", "server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:34:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:34:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:34:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:34:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Creating event network-vif-plugged:aded16b1-1b80-4e18-ab01-ea36010cc6ff for instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 on user Nov 28 20:34:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] Creating event network-changed:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:34:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-2adeec5b-4022-4adf-844c-307038d40231 req-90a1bfb2-b012-41e2-8e7c-fb58c4fba0a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.031752 Nov 28 20:34:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 305/916] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:34:37 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=18 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:03 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid 29443f30-6d05-4148-9185-a31f78b4a68f {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:35:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f8631072-e191-491b-a4a5-81276a325e58 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/action" status: 200 len: 32 microversion: 2.1 time: 0.109525 Nov 28 20:35:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 306/917] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:35:03 2023] POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/action => generated 32 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:03 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-68ce7c1c-d4f0-4d12-b719-64aaa316fb8a tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1508 microversion: 2.1 time: 0.254810 Nov 28 20:35:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 307/918] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:35:03 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1508 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] Creating event network-vif-unplugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1a2d9b95-a723-40ab-8fa9-04439462a088 req-42d1c0c5-8533-4466-9dca-7af90fb5be36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036514 Nov 28 20:35:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 306/919] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Creating event network-vif-unplugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-d12b1a0a-86e8-4368-adb5-9655b3f69b3e req-99e31d11-ee57-482a-8421-6253ab0b6afa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.096519 Nov 28 20:35:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 307/920] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:06 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:35:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-b177e868-eff4-4bb0-bc5f-1e0b792a2bcc req-a8ee3fff-55a7-453b-ae8b-b909cb24da0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031307 Nov 28 20:35:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 308/921] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:16 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5e704a63-75e3-4a09-a12d-c76cf6636029 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1655 microversion: 2.1 time: 0.208816 Nov 28 20:35:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 307/922] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:35:16 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1655 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-38ce3d45-9086-4d8d-ba74-f171771ef978 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments/a4ee6c09-63e2-482f-bdbd-db3e6b99273d" status: 200 len: 194 microversion: 2.20 time: 0.251661 Nov 28 20:35:20 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 308/923] 10.0.0.210 () {64 vars in 1531 bytes} [Tue Nov 28 20:35:20 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments/a4ee6c09-63e2-482f-bdbd-db3e6b99273d => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'services' on Instance uuid 93698818-d7ba-4f25-a341-30e5390a829e {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:35:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-b44ab074-76db-4cff-b48a-ce2cbc7addb0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments/a4ee6c09-63e2-482f-bdbd-db3e6b99273d" status: 202 len: 0 microversion: 2.20 time: 0.248065 Nov 28 20:35:20 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 309/924] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 20:35:20 2023] DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments/a4ee6c09-63e2-482f-bdbd-db3e6b99273d => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-dd3562c9-3528-4cd8-a735-6d2a5b63389b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064059 Nov 28 20:35:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 308/925] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 20:35:20 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HTTP exception thrown: Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 could not be found. Nov 28 20:35:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Returning 404 to user: Instance 5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:35:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-999f477b-84ed-451c-9020-de9c0092922d tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867" status: 404 len: 111 microversion: 2.87 time: 0.031226 Nov 28 20:35:25 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 309/926] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:35:25 2023] GET /compute/v2.1/servers/5695c6cb-ce2e-4d67-9a7e-07b1c0ac0867 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:25 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:35:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f08a1e98-fddf-4238-b061-de769f2dd749 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 204 len: 0 microversion: 2.87 time: 0.170601 Nov 28 20:35:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 310/927] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:35:25 2023] DELETE /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "name": "network-vif-unplugged", "status": "completed", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:26 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] Creating event network-vif-unplugged:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:35:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b55a0428-37a7-4970-8a08-388cd7362912 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 200 len: 1696 microversion: 2.87 time: 0.222467 Nov 28 20:35:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 309/928] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:35:26 2023] GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 1696 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:35:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-4ee27c7f-59a0-4790-9022-b608d56b3f50 req-69ef7046-0650-4e9b-ad96-dad3f85179d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037512 Nov 28 20:35:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 310/929] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fc354dbc-8d00-4573-b225-169ba0781b06 tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047342 Nov 28 20:35:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 311/930] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:35:27 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HTTP exception thrown: Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 is not attached to volume 851647b5-5c40-45e4-bfa4-8dc829d269f4 Nov 28 20:35:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Returning 404 to user: Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 is not attached to volume 851647b5-5c40-45e4-bfa4-8dc829d269f4 {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:35:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9f29849f-6b88-4e3b-9a1f-97b39d07465e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments/851647b5-5c40-45e4-bfa4-8dc829d269f4" status: 404 len: 154 microversion: 2.1 time: 0.089747 Nov 28 20:35:27 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 310/931] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:35:27 2023] DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804/os-volume_attachments/851647b5-5c40-45e4-bfa4-8dc829d269f4 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:35:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "name": "network-vif-plugged", "status": "completed", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}, {"server_uuid": "e6f2a651-b10a-45f4-8f94-6a4426654a86", "name": "network-vif-deleted", "tag": "18a58452-a51f-448e-86d4-d6bdf0ec46cd"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Creating event network-vif-plugged:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:35:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] Creating event network-vif-deleted:18a58452-a51f-448e-86d4-d6bdf0ec46cd for instance e6f2a651-b10a-45f4-8f94-6a4426654a86 on user Nov 28 20:35:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-5ea2c44f-d29c-477f-8c09-1ecc7166bab8 req-0fa11b7b-5b32-4d6c-9a1f-c267dba79b68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037069 Nov 28 20:35:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 311/932] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:30 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:35:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-00ae8aa8-43c4-4d2d-8b6f-4df68bebaebd tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 204 len: 0 microversion: 2.1 time: 0.106690 Nov 28 20:35:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 312/933] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:35:30 2023] DELETE /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-unplugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:31 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:31 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6722115f609e44ccad60d00c89a04ddb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4fb173b085164da1b53412e2948fbdfe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] Creating event network-vif-unplugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:35:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b04bbd95-509e-41cd-b8fa-089b06f5ed5e tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 200 len: 1540 microversion: 2.1 time: 0.381841 Nov 28 20:35:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-38ca957d-eafc-485d-9947-93e550d2207b req-4bd4e314-93cd-4acc-bd12-e90b4e57592f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042007 Nov 28 20:35:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 312/934] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 311/935] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:35:30 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 1540 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:35:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-deleted", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] Creating event network-vif-deleted:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:35:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-0684da11-b7aa-4306-a5b1-7c342b0970a1 req-ad8399bc-9207-474c-add0-3bc6292afae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046335 Nov 28 20:35:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 313/936] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:35:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "136d54f3-eb9a-46fc-8b5f-318b68500804", "name": "network-vif-plugged", "status": "completed", "tag": "48a201ba-2910-4d94-b7a9-ac3878402adf"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:35:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] Creating event network-vif-plugged:48a201ba-2910-4d94-b7a9-ac3878402adf for instance 136d54f3-eb9a-46fc-8b5f-318b68500804 on user Nov 28 20:35:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a8168baf-524d-41cd-ac99-c280f110f0c0 req-24baa00b-73a9-454a-bc52-2bca24303e33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036616 Nov 28 20:35:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 313/937] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:35:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=30 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:35:53 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:35:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a60a85da-568d-4789-bee1-5dfbc2d63af8 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1488 microversion: 2.1 time: 0.263197 Nov 28 20:35:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 312/938] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:35:53 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1488 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a546981c-4300-43e7-86c3-7fb4809b3d8f tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050092 Nov 28 20:36:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 314/939] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 20:36:10 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=16 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:10 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:36:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-cacc2842-864a-4c76-bca1-4c80e555a628 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 204 len: 0 microversion: 2.20 time: 0.115454 Nov 28 20:36:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 314/940] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:36:10 2023] DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:11 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-unplugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:11 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:11 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] Creating event network-vif-unplugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:36:11 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ddcba6cb-73be-493d-97d5-95e188a9936f req-663a98c5-0a8c-4f78-a21b-8f3ac81451e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033513 Nov 28 20:36:11 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 315/941] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:11 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e9421c17-4ca7-43d0-bef4-9c206e4b7233 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 200 len: 1709 microversion: 2.20 time: 0.300450 Nov 28 20:36:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 313/942] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:36:11 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 1709 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:36:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-plugged", "status": "completed", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}, {"server_uuid": "93698818-d7ba-4f25-a341-30e5390a829e", "name": "network-vif-deleted", "tag": "4258c97f-0a86-4cf4-ade0-831330204fc8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Creating event network-vif-plugged:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:36:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] Creating event network-vif-deleted:4258c97f-0a86-4cf4-ade0-831330204fc8 for instance 93698818-d7ba-4f25-a341-30e5390a829e on user Nov 28 20:36:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7e9c8bb2-2d04-41e5-a566-2b70997d4a3c req-51cd89c4-76fc-46a0-aaee-d7bd246f6337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032794 Nov 28 20:36:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 315/943] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: e6f2a651-b10a-45f4-8f94-6a4426654a86] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HTTP exception thrown: Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 could not be found. Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Returning 404 to user: Instance e6f2a651-b10a-45f4-8f94-6a4426654a86 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:36:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2461ee4a-cb38-4867-9c54-16c4e1b49b4f tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86" status: 404 len: 111 microversion: 2.87 time: 0.036523 Nov 28 20:36:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 316/944] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:36:16 2023] GET /compute/v2.1/servers/e6f2a651-b10a-45f4-8f94-6a4426654a86 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:36:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1ba701c4-8b55-4181-9882-3157d5b24121 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 204 len: 0 microversion: 2.87 time: 0.104037 Nov 28 20:36:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 314/945] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:36:16 2023] DELETE /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-unplugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fc90b997-ba50-468e-9a16-87ff2a7041f2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049209 Nov 28 20:36:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 317/946] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:36:16 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] Creating event network-vif-unplugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:36:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-81ef1414-3d4d-45b3-be1c-849feb92e638 req-1103eb1d-0c38-4159-8fb8-a0003d0e9920 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032703 Nov 28 20:36:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 315/947] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:16 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bcf07c7e-434d-4f5a-a202-24b0e95cb3a8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 200 len: 1774 microversion: 2.87 time: 0.310438 Nov 28 20:36:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 316/948] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:36:16 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 1774 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:36:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-481f3658-8a1a-4ae4-8db2-3d69c91d4591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 204 len: 0 microversion: 2.1 time: 0.122781 Nov 28 20:36:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 318/949] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:36:16 2023] DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:17 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3c56f706-57a3-4de1-be50-551e82380034 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 200 len: 1661 microversion: 2.1 time: 0.309734 Nov 28 20:36:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 316/950] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:36:16 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 1661 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:36:18 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-deleted", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:18 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] Creating event network-vif-deleted:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-bd37268d-abf1-4e37-b271-0199be4e06a6 req-ac825480-3d0f-47ab-b1dc-de35c6577b06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041970 Nov 28 20:36:18 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 317/951] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:36:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-plugged", "status": "completed", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-unplugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-unplugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "636a8f00-7685-4c1b-9404-cf16359dd08a", "name": "network-vif-plugged", "status": "completed", "tag": "23e84680-3abf-49b8-9750-1a0a3cd8b4cb"}, {"server_uuid": "313a065e-94f3-4435-97af-6a16de64ca7c", "name": "network-vif-deleted", "tag": "d8b8da62-7cf3-4b0d-81b0-181bc7f571bd"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-plugged:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-unplugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-unplugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-plugged:23e84680-3abf-49b8-9750-1a0a3cd8b4cb for instance 636a8f00-7685-4c1b-9404-cf16359dd08a on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] Creating event network-vif-deleted:d8b8da62-7cf3-4b0d-81b0-181bc7f571bd for instance 313a065e-94f3-4435-97af-6a16de64ca7c on user Nov 28 20:36:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-8d61dd05-ab28-4016-b3ad-fa20f263e69e req-3e4859f5-4104-493b-9dd7-b4c249d9d269 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1384 microversion: 2.1 time: 0.042026 Nov 28 20:36:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 319/952] 10.0.0.210 () {68 vars in 1395 bytes} [Tue Nov 28 20:36:18 2023] POST /compute/v2.1/os-server-external-events => generated 1384 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] [instance: 136d54f3-eb9a-46fc-8b5f-318b68500804] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] HTTP exception thrown: Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 could not be found. Nov 28 20:36:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Returning 404 to user: Instance 136d54f3-eb9a-46fc-8b5f-318b68500804 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:36:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-50b52d93-fb98-4a91-bf75-88f0aa4f0beb tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804" status: 404 len: 111 microversion: 2.1 time: 0.028828 Nov 28 20:36:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 317/953] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:36:21 2023] GET /compute/v2.1/servers/136d54f3-eb9a-46fc-8b5f-318b68500804 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:36:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f9aa6658-b638-4883-b0e2-21f103aa29ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] Calling method '.version_select at 0x7f9e649535b0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f9aa6658-b638-4883-b0e2-21f103aa29ba tempest-TestMinimumBasicScenario-1412958496 tempest-TestMinimumBasicScenario-1412958496-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-661508500" status: 202 len: 0 microversion: 2.1 time: 0.025030 Nov 28 20:36:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 318/954] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Nov 28 20:36:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-661508500 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c1925d7-5ca4-4da7-a1f8-d580f6d8e940"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 29443f30-6d05-4148-9185-a31f78b4a68f while it is in vm_state rescued Nov 28 20:36:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Returning 409 to user: Cannot 'attach_volume' instance 29443f30-6d05-4148-9185-a31f78b4a68f while it is in vm_state rescued {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:36:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ea835307-5b60-4d73-9dd5-dd37867dcc91 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046914 Nov 28 20:36:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 320/955] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:36:54 2023] POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/os-volume_attachments => generated 152 bytes in 49 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-74f3f5ca-0768-40af-aac0-f43a9ff0894b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/action" status: 202 len: 0 microversion: 2.1 time: 0.073916 Nov 28 20:36:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 318/956] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:36:54 2023] POST /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:54 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:36:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e247ba9f-e568-49dd-9037-3b1eb13a3673 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1496 microversion: 2.1 time: 0.277413 Nov 28 20:36:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 319/957] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:36:54 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1496 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:36:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] Creating event network-vif-unplugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:36:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-74805017-f5d4-4861-8c77-9cb537899fca req-141d937f-431f-4886-b1c7-b745740f9836 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037274 Nov 28 20:36:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 321/958] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:36:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}, {"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:36:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:36:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:36:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:36:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:36:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:36:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:36:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-50a466dc-f333-4a1d-a7eb-2c165b345020 req-0ad5b741-2626-460f-a9d5-0bb97e0062da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.029243 Nov 28 20:36:57 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 319/959] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:36:57 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. Nov 28 20:37:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:37:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bb495249-330b-423f-9d31-977192e2819e tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 404 len: 111 microversion: 2.20 time: 0.030124 Nov 28 20:37:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 320/960] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:01 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:37:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fe6bd615-e774-468f-9ddf-1c7bde29de00 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '.version_select at 0x7f9e6431c1f0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fe6bd615-e774-468f-9ddf-1c7bde29de00 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958726701" status: 204 len: 0 microversion: 2.20 time: 0.023227 Nov 28 20:37:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 322/961] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 20:37:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958726701 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:37:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-62a17cf1-0f7a-4193-b24d-c4134f358cf6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: .version_select at 0x7f9e6433be20>, body: {"keypair": {"name": "tempest-keypair-144574904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGf7rbfGmkbg9QNV+1Z0B5neiR0PzgqzwGOYvM5FfRWYx4MTDS+q5fQSTS7YZMLSQKaPn3qR8rnvfsfmD+tnK7T3zFPx8mNCJ/Lwe8ouSkwiQJ7T9kBYNHl5Hsq+Bpyrbw=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:02 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-62a17cf1-0f7a-4193-b24d-c4134f358cf6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for project 292cfffce13446c8963785adfb4b9d22. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:37:02 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-62a17cf1-0f7a-4193-b24d-c4134f358cf6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for user 9e21afd3261f4b1a87f7cbb4348fc9fe and project 292cfffce13446c8963785adfb4b9d22. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:37:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-62a17cf1-0f7a-4193-b24d-c4134f358cf6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046981 Nov 28 20:37:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 320/962] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Nov 28 20:37:02 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 28 20:37:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1654201794", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "5889ef34-4490-429e-b51e-1d7d050c1ee7"}], "security_groups": [{"name": "tempest-securitygroup--674546420"}], "key_name": "tempest-keypair-144574904", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:03 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] validate_networks() for [('5889ef34-4490-429e-b51e-1d7d050c1ee7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for project 292cfffce13446c8963785adfb4b9d22. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Getting quotas for user 9e21afd3261f4b1a87f7cbb4348fc9fe and project 292cfffce13446c8963785adfb4b9d22. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:37:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:37:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-db3904d7-a518-4685-be2c-f8793c592295 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.602921 Nov 28 20:37:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 321/963] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Nov 28 20:37:03 2023] POST /compute/v2.1/servers => generated 399 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Nov 28 20:37:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:04 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:04 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:04 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:04 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ba93346e-80c6-411b-8165-63ce600d5dc0 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1273 microversion: 2.20 time: 0.194162 Nov 28 20:37:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 323/964] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:04 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1273 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 313a065e-94f3-4435-97af-6a16de64ca7c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HTTP exception thrown: Instance 313a065e-94f3-4435-97af-6a16de64ca7c could not be found. Nov 28 20:37:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Returning 404 to user: Instance 313a065e-94f3-4435-97af-6a16de64ca7c could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:37:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-451b0b69-83a9-4fb8-ad2d-d5e8a9a2fcc5 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c" status: 404 len: 111 microversion: 2.87 time: 0.027568 Nov 28 20:37:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 321/965] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:06 2023] GET /compute/v2.1/servers/313a065e-94f3-4435-97af-6a16de64ca7c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] Creating event network-changed:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-37bd3382-2b4b-4e3c-9703-0fc43d9276c7 req-5bd9c019-868e-4f38-8408-206caa7344e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Nov 28 20:37:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 322/966] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:37:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4a983b38-6377-4648-9c1d-b48249c32587 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 204 len: 0 microversion: 2.87 time: 0.120979 Nov 28 20:37:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 324/967] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:37:07 2023] DELETE /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-74aefe36-dce4-4439-9eb1-82257886b1c8 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 404 len: 111 microversion: 2.1 time: 0.033960 Nov 28 20:37:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 323/968] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:37:07 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6c54628a-6b7f-4063-b91c-5e1259f498b9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '.version_select at 0x7f9e6455f7f0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6c54628a-6b7f-4063-b91c-5e1259f498b9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076987994" status: 202 len: 0 microversion: 2.1 time: 0.030847 Nov 28 20:37:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 325/969] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:37:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1076987994 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "name": "network-vif-unplugged", "status": "completed", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:07 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '007af37c9a914cd5863e486c041701be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd03007966db45f48ae6c22ed6f84871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] Creating event network-vif-unplugged:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:37:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e1fe3b79-e854-43c4-83c8-03c527b15e0e tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 200 len: 1696 microversion: 2.87 time: 0.275505 Nov 28 20:37:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 322/970] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:07 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 1696 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:37:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-439ac0e9-8cb3-4c00-8dd7-7d4f6b578069 req-b6fa7a91-2228-4d41-970a-d23272ddf81a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049997 Nov 28 20:37:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 324/971] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:08 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6cbfc3e4-976b-41df-827f-345e42e2a361 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: .version_select at 0x7f9e64223e20>, body: {"keypair": {"name": "tempest-keypair-1870450819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHivpLEFHewBe75hA3vkXVSjm2rcngDMU8MzWAIs9hr82dC1yHwnlNAxOq+tbMixYbmJJZUyNtQZmq1b7++eaR9Vu9hM9QDPdVYXt+qPAysMg305JJHiOKta1HBk/xHvA=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:08 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-6cbfc3e4-976b-41df-827f-345e42e2a361 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for project a7d489de217644979c5888d97158a800. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:37:08 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-6cbfc3e4-976b-41df-827f-345e42e2a361 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for user d653c87883374ab59768ce28b2b9adfc and project a7d489de217644979c5888d97158a800. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:37:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6cbfc3e4-976b-41df-827f-345e42e2a361 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054406 Nov 28 20:37:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 326/972] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:37:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "name": "network-vif-deleted", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] Creating event network-vif-deleted:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:37:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-ee667d0c-a72a-4581-8d00-65fbe6da0bee req-c739b471-b906-4db9-aff8-595f14f0398f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027623 Nov 28 20:37:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 323/973] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4549e2e1-350f-47ce-80ef-8a2a8a6ef62e", "name": "network-vif-plugged", "status": "completed", "tag": "fc196680-3f93-4710-b508-752c9aa39f18"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:09 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] Creating event network-vif-plugged:fc196680-3f93-4710-b508-752c9aa39f18 for instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e on user Nov 28 20:37:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-bee1e470-8a86-4100-ac45-5e8a1f02b93e req-b07cd1d2-94ce-412b-9405-22541d4f97b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032420 Nov 28 20:37:09 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 325/974] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:37:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1098397521", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "0c40204c-6e11-4188-ac50-9e10214d9a08"}], "security_groups": [{"name": "tempest-securitygroup--1709164582"}], "key_name": "tempest-keypair-1870450819", "user_data": "}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] validate_networks() for [('0c40204c-6e11-4188-ac50-9e10214d9a08', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for project a7d489de217644979c5888d97158a800. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Getting quotas for user d653c87883374ab59768ce28b2b9adfc and project a7d489de217644979c5888d97158a800. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:37:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:37:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-11c171be-f6e6-4c5b-801a-98d51d3993da tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.603038 Nov 28 20:37:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 327/975] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:37:09 2023] POST /compute/v2.1/servers => generated 400 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:37:10 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-02f69dcc-33cd-4092-b276-62d45e0e75d1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:10 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-02f69dcc-33cd-4092-b276-62d45e0e75d1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:10 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-02f69dcc-33cd-4092-b276-62d45e0e75d1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:10 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-02f69dcc-33cd-4092-b276-62d45e0e75d1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 200 len: 1230 microversion: 2.1 time: 0.063350 Nov 28 20:37:10 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 324/976] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:37:10 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 1230 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:37:11 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}, {"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:11 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:37:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:37:11 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-93f8e4da-ffc0-479d-9c6a-9629158fab44 req-d090798b-1fad-42df-8440-4bd1650253db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078172 Nov 28 20:37:11 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 326/977] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:12 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] Creating event network-changed:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:37:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-52156f42-e997-417a-8631-c933f45b29ce req-5fa58498-4755-49dc-8048-fe9f21d43f3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032451 Nov 28 20:37:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 328/978] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "name": "network-vif-plugged", "status": "completed", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] Creating event network-vif-plugged:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:37:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-1389f169-2b02-4953-a86b-08491eea06f5 req-82ae72cf-faf5-4b50-a8d8-8ef830ffbff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038283 Nov 28 20:37:14 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 325/979] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "name": "network-vif-plugged", "status": "completed", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:37:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] Creating event network-vif-plugged:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:37:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-2c26b0c1-a85a-485c-a3fc-d48967ca37a8 req-82c4ff02-4862-49c2-bca9-31ee42cf4146 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055928 Nov 28 20:37:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 327/980] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:37:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:44 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a4c0edf1-c98e-4c13-a083-78ff07ddbd45 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1502 microversion: 2.1 time: 0.252407 Nov 28 20:37:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 329/981] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:37:44 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:54 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:37:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e48fee5e-aad6-439d-9c90-75a4a4b5b0a8 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1584 microversion: 2.20 time: 0.232179 Nov 28 20:37:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 326/982] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:54 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1584 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=22 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] [instance: 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:37:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] HTTP exception thrown: Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e could not be found. Nov 28 20:37:57 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] Returning 404 to user: Instance 4549e2e1-350f-47ce-80ef-8a2a8a6ef62e could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:37:57 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-25a81790-16e7-41e5-9738-bf66b587d9d8 tempest-ServerBootFromVolumeStableRescueTest-468878 tempest-ServerBootFromVolumeStableRescueTest-468878-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e" status: 404 len: 111 microversion: 2.87 time: 0.039624 Nov 28 20:37:57 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 328/983] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:37:57 2023] GET /compute/v2.1/servers/4549e2e1-350f-47ce-80ef-8a2a8a6ef62e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:01 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:38:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-451948f4-ab16-409d-b3c8-2894b0a9f769 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 200 len: 1537 microversion: 2.1 time: 0.336750 Nov 28 20:38:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 330/984] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:38:00 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 1537 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:38:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1767325736", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "e31d602e-932e-4387-bb9b-0c9fb0e0f717"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:30 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] validate_networks() for [('e31d602e-932e-4387-bb9b-0c9fb0e0f717', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Getting quotas for project b17c476044c24a87bb1e78cba8b2d4fe. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Getting quotas for user 69f82221168549d5a500a9553ed98c72 and project b17c476044c24a87bb1e78cba8b2d4fe. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:38:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:38:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-0d3642fc-d38f-4b39-a023-1ae605164e68 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.728338 Nov 28 20:38:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 327/985] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:38:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:38:31 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a95cd664-2495-4f4e-a4ab-0e9897121f7b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:31 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a95cd664-2495-4f4e-a4ab-0e9897121f7b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:31 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:31 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:31 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a95cd664-2495-4f4e-a4ab-0e9897121f7b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f82221168549d5a500a9553ed98c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17c476044c24a87bb1e78cba8b2d4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:38:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a95cd664-2495-4f4e-a4ab-0e9897121f7b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234" status: 200 len: 1206 microversion: 2.1 time: 0.075931 Nov 28 20:38:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 329/986] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:38:31 2023] GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234 => generated 1206 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899045e8-9836-4139-9546-78f57348a234", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] Creating event network-changed:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:38:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-f8e9b5ed-43c9-4fb7-97ed-d78c4024926a req-d310c8c6-c620-4ea9-9228-c766092eebbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033448 Nov 28 20:38:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 331/987] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:33 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899045e8-9836-4139-9546-78f57348a234", "name": "network-vif-plugged", "status": "completed", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] Creating event network-vif-plugged:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:38:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-fa1ba15d-5265-4d69-a3d3-9f278a29b7a7 req-605c9b79-f364-4657-8c26-3f3ed946381f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046278 Nov 28 20:38:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 328/988] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899045e8-9836-4139-9546-78f57348a234", "name": "network-vif-plugged", "status": "completed", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] Creating event network-vif-plugged:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:38:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ed34d36b-7a4d-48a7-9951-a9c06d8a414d req-cb3497dc-59de-4372-9441-0a62e8d185d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031966 Nov 28 20:38:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 330/989] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-607110c9-8d00-49e5-a206-3f7d9246caa7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: .version_select at 0x7f9e6431fd00>, body: {"keypair": {"name": "tempest-keypair-249978267", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWg6YbMlebQ5V+UbkiDrrgElaYoiXY9oYImEppuaL6/Oo5HZCbiLccGXYvygaEUJySbNh/P4i1kz+O1q3We6pyWNWE9nV6EgEtTcw+bkFNGx5lVpre5FiMuKcW99C0YaA=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:47 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-607110c9-8d00-49e5-a206-3f7d9246caa7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:38:47 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-607110c9-8d00-49e5-a206-3f7d9246caa7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for user 634123644067453a92f4d43da0b28fa7 and project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:38:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-607110c9-8d00-49e5-a206-3f7d9246caa7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053042 Nov 28 20:38:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 332/990] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:38:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1401374666", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "05832c98-5094-434e-8832-8d7b10329513"}], "security_groups": [{"name": "tempest-securitygroup--571988379"}], "key_name": "tempest-keypair-249978267", "user_data": "}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] validate_networks() for [('05832c98-5094-434e-8832-8d7b10329513', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:38:48 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Getting quotas for user 634123644067453a92f4d43da0b28fa7 and project d72dc075421c4e7eb9c0ff2bf1641a92. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:38:49 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:38:49 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-eab122be-3b98-40cd-b5a6-0ec9b411c860 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.603131 Nov 28 20:38:49 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 329/991] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:38:48 2023] POST /compute/v2.1/servers => generated 406 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f26a8b7b-63c8-4d9e-8eb0-93b42aa005ed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f26a8b7b-63c8-4d9e-8eb0-93b42aa005ed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:49 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-f26a8b7b-63c8-4d9e-8eb0-93b42aa005ed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:38:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f26a8b7b-63c8-4d9e-8eb0-93b42aa005ed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1237 microversion: 2.1 time: 0.075673 Nov 28 20:38:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 331/992] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:38:49 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1237 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:38:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] Creating event network-changed:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:38:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-789e263e-0d95-456e-9335-de074a7e8664 req-788efc88-32d9-4fe1-867e-016e8ab970f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087803 Nov 28 20:38:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 333/993] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:38:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-e4d19330-082c-4cda-b9bc-a234f974d37d req-383cf3aa-0c53-4ca8-94bd-c59725eb5711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028889 Nov 28 20:38:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 330/994] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-d2e87d14-1d03-40c5-ae76-85bb569e11ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.137797 Nov 28 20:38:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 332/995] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Nov 28 20:38:54 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-interface => generated 282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:38:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:38:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3c763641-edf3-4f71-874e-e695b8b63322 req-067589fd-e84e-4350-bb54-342faf0ce0b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032939 Nov 28 20:38:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 334/996] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:55 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:55 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] Creating event network-changed:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:38:55 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-ef6d1d4a-76bc-4c0f-9578-b18c7d5945bf req-0fe8d21d-dc48-4c1c-b919-809dc092f4ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036049 Nov 28 20:38:55 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 331/997] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:38:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f0eac54c-ee6b-47d8-8af8-4d798b59f70b tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/ips" status: 200 len: 110 microversion: 2.20 time: 0.039423 Nov 28 20:38:56 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 333/998] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Nov 28 20:38:56 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:58 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lazy-loading 'flavor' on Instance uuid b2c27e15-6791-4d75-8df0-957c10d7ca42 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:38:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-39783890-9442-4b79-bcfe-a4656afc858d tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/action" status: 202 len: 0 microversion: 2.20 time: 0.927161 Nov 28 20:38:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 335/999] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:38:58 2023] POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:38:59 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9a036b98-f633-4254-aeae-6eacca61721c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1709 microversion: 2.20 time: 0.346018 Nov 28 20:39:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 332/1000] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:38:59 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1709 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:39:00 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-unplugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:39:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] Creating event network-vif-unplugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:39:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-14056685-f2c2-48f2-9e87-ab024450919e req-f1ad58d5-97eb-4457-a79c-06d8f7b0eeb3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156147 Nov 28 20:39:00 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 334/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:39:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-5f5e6d83-1fe8-41be-8403-4179e63265c9 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.143717 Nov 28 20:39:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 336/1002] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:39:01 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-interface => generated 283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}, {"name": "network-changed", "server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:39:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:39:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] Creating event network-changed:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:39:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-da64e873-5459-419d-8381-9717c3f3c327 req-3b39c700-0d1e-423b-84a9-85a47e5aaa5d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.032066 Nov 28 20:39:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 333/1003] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:39:02 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-aac89217-97db-40a5-b799-783df0999fcb tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/ips" status: 200 len: 144 microversion: 2.1 time: 0.038841 Nov 28 20:39:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 335/1004] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:39:03 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:39:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] Creating event network-changed:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:39:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5af0dd4d-61ee-4b56-aaa7-435d667b2926 req-76d7cd9c-c943-476b-bb87-e7e3f870d5e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029946 Nov 28 20:39:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 337/1005] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:39:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "46ebfac3-6175-4b54-82dd-641171e96f2a"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e6751d3a-f523-4afa-8c88-1186ad904ec5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319872 Nov 28 20:39:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 334/1006] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:39:05 2023] POST /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=14 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ddfeacc6-5dbd-4999-935d-519195a9c9f5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049069 Nov 28 20:39:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 336/1007] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:39:15 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3472918c-3281-4988-8694-cfa49f388591 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a" status: 200 len: 194 microversion: 2.1 time: 0.049382 Nov 28 20:39:15 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 338/1008] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 20:39:15 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c703bb11-9d24-4f99-a851-84a95413edcb"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:18 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:18 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a16860a5-26df-4e33-aee6-6972c5ab8558 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300502 Nov 28 20:39:18 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 335/1009] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:39:18 2023] POST /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 194 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:21 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f82221168549d5a500a9553ed98c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17c476044c24a87bb1e78cba8b2d4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-ca01184e-000a-4180-9169-3b7fcbc9a4c9 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234" status: 200 len: 1485 microversion: 2.1 time: 0.202317 Nov 28 20:39:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 337/1010] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:39:21 2023] GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234 => generated 1485 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c2f28fe7-a466-4324-861e-6012ffff6e63 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048602 Nov 28 20:39:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 339/1011] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:39:28 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-bda518fe-fab5-433f-95de-8f383e3e33dd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a" status: 200 len: 194 microversion: 2.1 time: 0.043244 Nov 28 20:39:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 336/1012] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 20:39:28 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:28 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'services' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:39:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-eadda3dd-046c-4738-94a1-d597c9ee42c1 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a" status: 202 len: 0 microversion: 2.1 time: 0.188691 Nov 28 20:39:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 338/1013] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:39:28 2023] DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/46ebfac3-6175-4b54-82dd-641171e96f2a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:39 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-312c3af1-95b8-4904-8b57-83ed87b840da tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1550 microversion: 2.1 time: 0.224991 Nov 28 20:39:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 340/1014] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:39:39 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1550 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:50 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:39:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b68b36aa-3367-4267-aed1-8b9b7ab465c7 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1650 microversion: 2.20 time: 0.225932 Nov 28 20:39:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 337/1015] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:39:50 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1650 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2e876f28-6ba1-42e3-989a-f8ccbd335911 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/c703bb11-9d24-4f99-a851-84a95413edcb" status: 200 len: 194 microversion: 2.1 time: 0.048178 Nov 28 20:39:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 339/1016] 10.0.0.210 () {62 vars in 1490 bytes} [Tue Nov 28 20:39:51 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/c703bb11-9d24-4f99-a851-84a95413edcb => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:39:51 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lazy-loading 'services' on Instance uuid 3a2c4b6b-0fc7-4299-89ca-2d885e893854 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:39:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3c58964d-2bff-4895-a620-dfc906d455b2 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/c703bb11-9d24-4f99-a851-84a95413edcb" status: 202 len: 0 microversion: 2.1 time: 0.161597 Nov 28 20:39:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 341/1017] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:39:51 2023] DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments/c703bb11-9d24-4f99-a851-84a95413edcb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f176c869-263a-43d4-b030-92a1fbcc2f44 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041771 Nov 28 20:40:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 338/1018] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:40:13 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-57b0ef08-ddfb-4488-b767-b09b9c368edd tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049512 Nov 28 20:40:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 340/1019] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:40:13 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:14 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:40:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-6c94e8eb-03d8-46ed-b093-9467f4e53fe4 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 204 len: 0 microversion: 2.1 time: 0.122989 Nov 28 20:40:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 342/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:40:14 2023] DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:14 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd653c87883374ab59768ce28b2b9adfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7d489de217644979c5888d97158a800', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-06845aa5-59c2-495e-b23d-7e8b688067ad tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 200 len: 1661 microversion: 2.1 time: 0.249717 Nov 28 20:40:14 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 339/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:40:14 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 1661 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:40:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "name": "network-vif-unplugged", "status": "completed", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] Creating event network-vif-unplugged:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:40:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-602cf0b4-2013-4f8a-a375-07a4f96e1190 req-5f88a88d-9289-45c5-a098-1043de57ce1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039427 Nov 28 20:40:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 341/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "name": "network-vif-plugged", "status": "completed", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}, {"server_uuid": "3a2c4b6b-0fc7-4299-89ca-2d885e893854", "name": "network-vif-deleted", "tag": "3319037b-9d8f-47bd-908f-12f61b7ceea2"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Creating event network-vif-plugged:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:40:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] Creating event network-vif-deleted:3319037b-9d8f-47bd-908f-12f61b7ceea2 for instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 on user Nov 28 20:40:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-5cbe9456-fa39-4599-9459-b0debf62ee5b req-8f17d086-7024-40bd-a682-a3b9f94b73f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040282 Nov 28 20:40:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 343/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:16 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:28 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:40:28 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1cb13286-ccc0-4552-821d-258a2d9ab47b tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234" status: 204 len: 0 microversion: 2.1 time: 0.112659 Nov 28 20:40:28 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 340/1024] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:40:28 2023] DELETE /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:28 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69f82221168549d5a500a9553ed98c72', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b17c476044c24a87bb1e78cba8b2d4fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3a05ed6c-dd26-4558-9535-a10067eb7e47 tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234" status: 200 len: 1491 microversion: 2.1 time: 0.257947 Nov 28 20:40:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 342/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:40:28 2023] GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234 => generated 1491 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899045e8-9836-4139-9546-78f57348a234", "name": "network-vif-unplugged", "status": "completed", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] Creating event network-vif-unplugged:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:40:28 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-a6388d54-7eba-41cf-954d-82af3819256f req-1e7ae8c5-ce18-46f9-b317-33ee77bbb74c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173471 Nov 28 20:40:28 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 344/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899045e8-9836-4139-9546-78f57348a234", "name": "network-vif-deleted", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] Creating event network-vif-deleted:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:40:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-ff7d3c81-84c8-4909-9750-ed3fd7617329 req-95216527-70c5-46ce-bf4f-813f27f7e67a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080452 Nov 28 20:40:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 341/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899045e8-9836-4139-9546-78f57348a234", "name": "network-vif-plugged", "status": "completed", "tag": "440b18b0-f9a0-422c-a9a9-1cd0f25af43d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] Creating event network-vif-plugged:440b18b0-f9a0-422c-a9a9-1cd0f25af43d for instance 899045e8-9836-4139-9546-78f57348a234 on user Nov 28 20:40:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-f3ac1efe-ae9f-42a3-a555-aec7a676f22e req-9c77e51a-e0b0-43e7-a3b3-55da3eb8e37f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Nov 28 20:40:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 343/1028] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-610359fc-2127-4769-b2ae-dfc144d275a7 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.175194 Nov 28 20:40:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 345/1029] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:40:39 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-interface => generated 282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] Creating event network-changed:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:40:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-3eb5ce27-decf-40b8-87f3-07ac6dd8c183 req-ed6ff85c-25a4-4dc2-adf7-56dcbed391cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040361 Nov 28 20:40:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 342/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9d0bf49-e1ad-4031-9ad6-10aade724351"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-117f4ad3-6200-42f9-8881-e17de47bd705 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298934 Nov 28 20:40:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 344/1031] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:40:40 2023] POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'flavor' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc5091ec-1e25-4945-8dd8-3ee3331e1a1c"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-74463b94-ccc4-4da5-9535-bdbaea9feeed tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/action" status: 200 len: 32 microversion: 2.1 time: 0.209175 Nov 28 20:40:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 343/1032] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:40:50 2023] POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/action => generated 32 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:50 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-43f1248c-5cd2-45a3-89d9-ab4023404eb5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.468992 Nov 28 20:40:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 346/1033] 10.0.0.210 () {66 vars in 1441 bytes} [Tue Nov 28 20:40:50 2023] POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments => generated 188 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-33d17bff-c38b-451f-92c7-f29c1a5d91ff tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments/dc5091ec-1e25-4945-8dd8-3ee3331e1a1c" status: 202 len: 0 microversion: 2.20 time: 0.237621 Nov 28 20:40:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 344/1034] 10.0.0.210 () {64 vars in 1534 bytes} [Tue Nov 28 20:40:51 2023] DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments/dc5091ec-1e25-4945-8dd8-3ee3331e1a1c => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=65585) unshelve /opt/stack/nova/nova/compute/api.py:4642}} Nov 28 20:40:51 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-61ce2087-ba12-4851-9fd2-fb676b86971d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1720 microversion: 2.1 time: 0.667115 Nov 28 20:40:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 345/1035] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:40:50 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1720 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:40:51 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9b2ccc37-3f37-4968-9fb0-bd00a18b72c5 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/action" status: 202 len: 0 microversion: 2.20 time: 0.138446 Nov 28 20:40:51 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 347/1036] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Nov 28 20:40:51 2023] POST /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:51 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:40:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-176a17d9-6998-46bd-ae6b-1ee2f4de54bb tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1658 microversion: 2.20 time: 0.263723 Nov 28 20:40:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 345/1037] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:40:51 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1658 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:40:52 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-unplugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:52 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] Creating event network-vif-unplugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:40:52 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-126e4cba-3c8d-4db3-ab9a-8b4bb3aaeca4 req-26fd5e6e-409f-4fdf-995e-0f1f2571fa0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055791 Nov 28 20:40:52 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 346/1038] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] Creating event network-changed:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:40:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-165ecce1-2174-43b9-9a68-ddaf9dfdced3 req-a6ad9579-4488-4586-b5b4-84835eb25a45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037512 Nov 28 20:40:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 348/1039] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:40:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-20aebaad-600d-456c-8655-b267ea1705ce req-bc49f483-7a9d-48c9-b716-44830cd387ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029019 Nov 28 20:40:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 346/1040] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:40:56 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}, {"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:40:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:40:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:40:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:40:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:40:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:40:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-0a2b068f-7e22-46ed-a473-f77a6accb1cc req-09dcf2e4-53f4-4154-b417-f2a894ef2380 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040035 Nov 28 20:40:56 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 347/1041] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:40:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:00 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:00 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:41:00 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-326698cb-aab9-49a9-884d-4e73309daaea req-f607bc57-db90-4c80-9c21-86e9fddb9928 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048681 Nov 28 20:41:00 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 349/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:41:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:41:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-99a7621f-b490-4c4e-bb29-a03a75d6c6f6 req-07e722bb-6e65-4b6d-b498-030015e4993b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030510 Nov 28 20:41:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 347/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:41:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. Nov 28 20:41:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-fda2534b-8050-4cde-9e22-ae1319303345 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 404 len: 111 microversion: 2.1 time: 0.037669 Nov 28 20:41:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 348/1044] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:04 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:41:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-95329649-648f-4db7-8d3a-3eceda7332fe tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '.version_select at 0x7f9e6431f490>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-95329649-648f-4db7-8d3a-3eceda7332fe tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870450819" status: 202 len: 0 microversion: 2.1 time: 0.025402 Nov 28 20:41:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 350/1045] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:41:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870450819 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. Nov 28 20:41:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9747f7e8-5af6-40fa-a5cd-040833c01282 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 404 len: 111 microversion: 2.1 time: 0.047877 Nov 28 20:41:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 348/1046] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:41:14 2023] DELETE /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 3a2c4b6b-0fc7-4299-89ca-2d885e893854] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. Nov 28 20:41:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 3a2c4b6b-0fc7-4299-89ca-2d885e893854 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-95e310fd-92df-49e4-bf51-2ca7fb33e16a tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854" status: 404 len: 111 microversion: 2.1 time: 0.038873 Nov 28 20:41:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 349/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:15 2023] GET /compute/v2.1/servers/3a2c4b6b-0fc7-4299-89ca-2d885e893854 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] [instance: 899045e8-9836-4139-9546-78f57348a234] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] HTTP exception thrown: Instance 899045e8-9836-4139-9546-78f57348a234 could not be found. Nov 28 20:41:18 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] Returning 404 to user: Instance 899045e8-9836-4139-9546-78f57348a234 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:18 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2b7bac15-2d65-4743-b4ae-3d8f7d6323bf tempest-VolumesActionsTest-1841711590 tempest-VolumesActionsTest-1841711590-project-member] 10.0.0.210 "GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234" status: 404 len: 111 microversion: 2.1 time: 0.064193 Nov 28 20:41:18 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 351/1048] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:18 2023] GET /compute/v2.1/servers/899045e8-9836-4139-9546-78f57348a234 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. Nov 28 20:41:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-d765cbb8-b6e7-4c10-8362-8d508ae9b5d5 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 404 len: 111 microversion: 2.1 time: 0.027821 Nov 28 20:41:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 349/1049] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:41:19 2023] DELETE /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] [instance: 636a8f00-7685-4c1b-9404-cf16359dd08a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] HTTP exception thrown: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. Nov 28 20:41:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] Returning 404 to user: Instance 636a8f00-7685-4c1b-9404-cf16359dd08a could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:41:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bf75f5bb-6c6e-435b-9eed-62f9bce56a62 tempest-AttachVolumeTestJSON-187128538 tempest-AttachVolumeTestJSON-187128538-project-member] 10.0.0.210 "GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a" status: 404 len: 111 microversion: 2.1 time: 0.034159 Nov 28 20:41:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 350/1050] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:19 2023] GET /compute/v2.1/servers/636a8f00-7685-4c1b-9404-cf16359dd08a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 28 20:41:38 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:38 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8ca1f0ec-f9af-460f-a04d-223a0b9001dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Action: 'create', calling method: .version_select at 0x7f9e645e77f0>, body: {"keypair": {"name": "tempest-keypair-232633400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNW2Ol1IiPRGYOvr8k5pIvcbfcrOd7C7P2kNo49zDE60g5fhSRy+NlgnDBmQy85DvdPH/mTRWv2S80dFNjCrhw/dFimPWoqVAZVWu2Jd6crzaEjPsqKrUPbxEHhDG802A=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:38 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8ca1f0ec-f9af-460f-a04d-223a0b9001dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting quotas for project 335d61798b224867b31a4c78fcc33d83. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:41:38 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8ca1f0ec-f9af-460f-a04d-223a0b9001dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting quotas for user 5a9546b6c4e84a5890b690340c414506 and project 335d61798b224867b31a4c78fcc33d83. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:41:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8ca1f0ec-f9af-460f-a04d-223a0b9001dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.180410 Nov 28 20:41:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 352/1051] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:41:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "networks": [{"uuid": "4e671b0b-2ab3-4d0a-aa29-33b492f38b43"}], "security_groups": [{"name": "tempest-securitygroup--1007249665"}], "key_name": "tempest-keypair-232633400", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:39 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] validate_networks() for [('4e671b0b-2ab3-4d0a-aa29-33b492f38b43', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting quotas for project 335d61798b224867b31a4c78fcc33d83. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Getting quotas for user 5a9546b6c4e84a5890b690340c414506 and project 335d61798b224867b31a4c78fcc33d83. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:41:40 user devstack@n-api.service[65586]: WARNING nova.utils [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Hostname tempest-TestServerVolumeAttachScenarioOldVersion-server-325300438 is longer than 63, truncate it to tempest-TestServerVolumeAttachScenarioOldVersion-server-3253004 Nov 28 20:41:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:41:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c6dcd07a-2df6-404f-8fe8-836b4927d491 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.645643 Nov 28 20:41:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 350/1052] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:41:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:41:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0721340d-ca63-4c6a-ae3c-2f605c054c8e tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0721340d-ca63-4c6a-ae3c-2f605c054c8e tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:40 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:40 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:41:40 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-0721340d-ca63-4c6a-ae3c-2f605c054c8e tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:41:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0721340d-ca63-4c6a-ae3c-2f605c054c8e tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 200 len: 1248 microversion: 2.1 time: 0.161468 Nov 28 20:41:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 351/1053] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:40 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 1248 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:41 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:41 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:41:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c671fbca-3eed-47bb-847c-668d4c7b59e2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1700 microversion: 2.1 time: 0.414742 Nov 28 20:41:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 353/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:41:41 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1700 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:41:42 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:41:42 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:41:42 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:41:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e9ad6395-6cec-4dc3-a4bb-0136d2eba305 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1703 microversion: 2.20 time: 0.218667 Nov 28 20:41:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 351/1055] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:41:41 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1703 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 28 20:41:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] Creating event network-changed:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:41:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-3b8e0c46-d727-405f-9247-1aa8ddcaccd8 req-39724dc0-b733-499c-8e94-77adc2263e55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033530 Nov 28 20:41:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 352/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:41:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "name": "network-vif-plugged", "status": "completed", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] Creating event network-vif-plugged:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:41:44 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-ede5c425-c1e9-4613-95f2-0f697c2664ff req-4aa5a972-637b-4338-952e-6dd61a3d1838 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038638 Nov 28 20:41:44 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 354/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:41:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:41:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "name": "network-vif-plugged", "status": "completed", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:41:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:41:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:41:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:41:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] Creating event network-vif-plugged:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:41:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-847f8786-e67b-4e01-84cc-f6ff5d8716ca req-71c6cbd1-1ffc-4112-a1be-9df354986d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048025 Nov 28 20:41:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 352/1058] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:41:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:30 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:42:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2e96f24c-2612-40c9-9067-9039c30949e0 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 200 len: 1574 microversion: 2.1 time: 0.209606 Nov 28 20:42:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 353/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:42:30 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 1574 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HTTP exception thrown: Cannot 'detach_volume' instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 while it is in vm_state rescued Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Returning 409 to user: Cannot 'detach_volume' instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 while it is in vm_state rescued {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:42:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4bc9b288-8048-4dad-8a6c-9a1674cc383c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments/d9d0bf49-e1ad-4031-9ad6-10aade724351" status: 409 len: 152 microversion: 2.1 time: 0.246713 Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 355/1060] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:42:42 2023] DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments/d9d0bf49-e1ad-4031-9ad6-10aade724351 => generated 152 bytes in 249 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1cfe4359-63b8-4089-86af-b700a16640ac tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050140 Nov 28 20:42:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 353/1061] 10.0.0.210 () {64 vars in 1420 bytes} [Tue Nov 28 20:42:42 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-f5837718-5174-4957-953d-c2d611c3c505 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/action" status: 202 len: 0 microversion: 2.1 time: 0.097391 Nov 28 20:42:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 354/1062] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 20:42:42 2023] POST /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:42:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-2ab7130e-7c10-4fb8-8dd3-74a0683d2c5c tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 204 len: 0 microversion: 2.20 time: 0.130345 Nov 28 20:42:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 356/1063] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:42:42 2023] DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:42:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b3ed9016-95d6-4d98-a195-b4803dbb9ab2 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1708 microversion: 2.1 time: 0.234434 Nov 28 20:42:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 354/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:42:42 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1708 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-unplugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] Creating event network-vif-unplugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:42:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6cf6d149-8c24-4b38-8d48-ae07ccb1d91b req-d77824a4-e162-4459-bf34-9780ad154007 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031296 Nov 28 20:42:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 357/1065] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:42:42 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:42:43 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:42:43 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:42:43 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9e21afd3261f4b1a87f7cbb4348fc9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '292cfffce13446c8963785adfb4b9d22', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:42:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5009f573-cda0-46be-ad81-81cf8ca92da6 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 200 len: 1709 microversion: 2.20 time: 0.421444 Nov 28 20:42:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 355/1066] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:42:42 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 1709 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 28 20:42:43 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-unplugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:42:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:43 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] Creating event network-vif-unplugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:42:43 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-fa03833c-19d1-4341-a91b-294e7a9ecdaa req-bb2bfcf8-97a3-4b43-91eb-a7d234cbb64b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028922 Nov 28 20:42:43 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 355/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:42:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:42:44 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-plugged", "status": "completed", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}, {"server_uuid": "b2c27e15-6791-4d75-8df0-957c10d7ca42", "name": "network-vif-deleted", "tag": "bc13ffb2-0ccf-4e86-8502-bea728a1e20f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:42:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:44 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Creating event network-vif-plugged:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:42:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] Creating event network-vif-deleted:bc13ffb2-0ccf-4e86-8502-bea728a1e20f for instance b2c27e15-6791-4d75-8df0-957c10d7ca42 on user Nov 28 20:42:45 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-4f7a319b-4ee3-40e4-a865-5b5988dd4254 req-e3533dc9-3cc6-47d0-8db6-002d128f6c74 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031887 Nov 28 20:42:45 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 358/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:42:44 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:42:45 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}, {"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}, {"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:42:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:42:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:42:45 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:42:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:42:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:42:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:42:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-0e6af82f-6a01-46a6-aa1c-ae4dafb0a36b req-649ed535-3dcf-49d6-b5cb-ea9fb089db85 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034754 Nov 28 20:42:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 356/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:42:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=14 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fd577f37-e315-48c0-a926-d4d49fa54b63 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139547 Nov 28 20:43:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 356/1070] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:43:30 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] Creating event network-changed:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:43:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3621f422-0a80-463d-b0c0-d4bcf151d4e0 req-9107e70b-8cad-4e2c-a20d-dff23ce4e628 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062298 Nov 28 20:43:31 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 359/1071] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:43:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:33 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:43:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a55f47ef-21b7-495e-8d92-0c1538c61771 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1714 microversion: 2.1 time: 0.259049 Nov 28 20:43:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 357/1072] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:43:32 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1714 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:43:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f57dbcaa-39d7-4815-814f-075af170d16c tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 200 len: 1693 microversion: 2.1 time: 0.199460 Nov 28 20:43:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 357/1073] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:43:32 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 1693 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:43:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. Nov 28 20:43:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:43:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e6512796-640a-43e5-8812-c69444c27fcd tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 404 len: 111 microversion: 2.20 time: 0.028466 Nov 28 20:43:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 360/1074] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:43:33 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:43:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-80e8e138-30a3-4392-ad80-aa1fac4124ef tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '.version_select at 0x7f9e642c45e0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Searching by: {'deleted': False, 'project_id': '335d61798b224867b31a4c78fcc33d83'} {{(pid=65586) get_all /opt/stack/nova/nova/compute/api.py:3020}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-80e8e138-30a3-4392-ad80-aa1fac4124ef tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-144574904" status: 204 len: 0 microversion: 2.20 time: 0.034079 Nov 28 20:43:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 358/1075] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Nov 28 20:43:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-144574904 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 28 20:43:33 user devstack@n-api.service[65586]: DEBUG nova.compute.multi_cell_list [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=65586) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 28 20:43:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ce4ca8e6-511a-4177-ad06-8d6c8372cba1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 356 microversion: 2.1 time: 0.069762 Nov 28 20:43:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 358/1076] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Nov 28 20:43:33 2023] GET /compute/v2.1/servers => generated 356 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf5d52ce-bbdd-42d3-b468-464c38dc7ab8"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bb843b0b-5f96-46b8-bb51-2f8d66034304 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "POST /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269492 Nov 28 20:43:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 361/1077] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:43:35 2023] POST /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. Nov 28 20:43:37 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:43:37 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-97185446-622d-48b0-9163-4e5c4b4b4d23 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 404 len: 111 microversion: 2.20 time: 0.027096 Nov 28 20:43:37 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 359/1078] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:43:37 2023] DELETE /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: b2c27e15-6791-4d75-8df0-957c10d7ca42] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. Nov 28 20:43:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance b2c27e15-6791-4d75-8df0-957c10d7ca42 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:43:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-c59c7bb2-f5e7-4d31-af09-b343c2002f2a tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42" status: 404 len: 111 microversion: 2.20 time: 0.027213 Nov 28 20:43:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 359/1079] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:43:37 2023] GET /compute/v2.1/servers/b2c27e15-6791-4d75-8df0-957c10d7ca42 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. Nov 28 20:43:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:43:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c2cfce4c-0fd5-467b-ae40-9f0232e64cbc tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 404 len: 111 microversion: 2.20 time: 0.030616 Nov 28 20:43:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 362/1080] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Nov 28 20:43:40 2023] DELETE /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] [instance: 93698818-d7ba-4f25-a341-30e5390a829e] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] HTTP exception thrown: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. Nov 28 20:43:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] Returning 404 to user: Instance 93698818-d7ba-4f25-a341-30e5390a829e could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:43:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c6526b1d-ead3-46ea-b90d-fe918fd16d80 tempest-AttachVolumeShelveTestJSON-1442792072 tempest-AttachVolumeShelveTestJSON-1442792072-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e" status: 404 len: 111 microversion: 2.20 time: 0.030829 Nov 28 20:43:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 360/1081] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Nov 28 20:43:40 2023] GET /compute/v2.1/servers/93698818-d7ba-4f25-a341-30e5390a829e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-566dac35-f679-4df9-b41f-6705307afa40 req-3cde03e5-32da-43b5-bd62-0f26eb7852f1 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" status: 200 len: 302 microversion: 2.89 time: 0.163937 Nov 28 20:43:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 360/1082] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:43:45 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG nova.compute.api [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-0d276d52-0caf-4a5a-af9d-d3b6951cefa3 req-91bf48b9-d0e0-498a-91d9-1915e314ba4b tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" status: 200 len: 302 microversion: 2.89 time: 0.098007 Nov 28 20:43:46 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 363/1083] 10.0.0.210 () {66 vars in 1638 bytes} [Tue Nov 28 20:43:46 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 => generated 302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lazy-loading 'services' on Instance uuid 31463852-d5bb-4840-aa04-3bc48f95e03a {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:43:46 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a2be46b8-f952-4829-a3a5-4fbd94ad9ac5 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" status: 202 len: 0 microversion: 2.1 time: 0.202559 Nov 28 20:43:46 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 361/1084] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:43:46 2023] DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:46 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:46 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-b60a1d67-c239-4076-9568-8ca4b27efa22 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045365 Nov 28 20:43:46 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 361/1085] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:43:46 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-ee71b3f9-0205-497e-805a-eba6b21f7d0f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: .version_select at 0x7f9e645e5990>, body: {"keypair": {"name": "tempest-keypair-2067019178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/46ePml504hPEHQqQwlHayTrpifeFxrkouprNVaZfmM9bJRT8L0UdcDEGRU5k63AL7fQj7CVe1Xm846FrrhiuRF0lBW8FhtlmCqASIwliEtIjLrn1+aKhzX1DPEraxhg=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:49 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-ee71b3f9-0205-497e-805a-eba6b21f7d0f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:43:49 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-ee71b3f9-0205-497e-805a-eba6b21f7d0f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:43:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-ee71b3f9-0205-497e-805a-eba6b21f7d0f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.090635 Nov 28 20:43:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 364/1086] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:43:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:50 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1667927386", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7"}], "security_groups": [{"name": "tempest-securitygroup--2097769874"}], "key_name": "tempest-keypair-2067019178", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] validate_networks() for [('1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:43:51 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:43:51 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-95b90930-aaf4-4332-8a69-332e7b8aa1af tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.590183 Nov 28 20:43:51 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 362/1087] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:43:50 2023] POST /compute/v2.1/servers => generated 400 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:43:51 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-303967e4-5b68-4e5d-a5d3-650f0b4eee9e tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:43:51 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-303967e4-5b68-4e5d-a5d3-650f0b4eee9e tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:43:51 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-303967e4-5b68-4e5d-a5d3-650f0b4eee9e tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:43:51 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-303967e4-5b68-4e5d-a5d3-650f0b4eee9e tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 200 len: 1234 microversion: 2.1 time: 0.059413 Nov 28 20:43:51 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 362/1088] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:43:51 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 1234 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:43:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] Creating event network-changed:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:43:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-8e740b0b-0484-47a9-b75f-ea482fcf3b4a req-d1dff566-e0b9-4d91-8615-45c557e2da81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028838 Nov 28 20:43:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 365/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:43:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:56 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "name": "network-vif-plugged", "status": "completed", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] Creating event network-vif-plugged:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:43:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7bac6697-42d2-478c-9c15-1c677c5b6e7c req-2875a2cb-902e-440f-b82e-6aeeb4efad8d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037597 Nov 28 20:43:56 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 363/1090] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:43:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:43:58 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "name": "network-vif-plugged", "status": "completed", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:43:58 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=32 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:43:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:43:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:43:58 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:43:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] Creating event network-vif-plugged:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:43:58 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-26983d46-646d-43fa-b72e-6225aad8ab74 req-bb91811a-e525-4c09-b409-da0be8fa94f8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031043 Nov 28 20:43:58 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 363/1091] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:43:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:33 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:33 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fe8f7f45-8dd7-4dc9-acaa-a82a8ce4224b tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.152823 Nov 28 20:44:33 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 366/1092] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:44:33 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-interface => generated 282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] Creating event network-changed:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:44:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-dc3ccafe-7613-4704-9d05-2fef27060bb5 req-47e344d4-b421-4eeb-bff0-3547b7cd7085 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118155 Nov 28 20:44:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 364/1093] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:44:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=18 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:34 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lazy-loading 'services' on Instance uuid f23739ef-322e-4a8f-9df3-2a06e42b6a35 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:44:34 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ff3d829e-9692-4231-b60e-ccd527dabf99 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments/d9d0bf49-e1ad-4031-9ad6-10aade724351" status: 202 len: 0 microversion: 2.1 time: 0.170233 Nov 28 20:44:34 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 364/1094] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:44:34 2023] DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments/d9d0bf49-e1ad-4031-9ad6-10aade724351 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f2255bc8-2dad-4bd2-af59-86e3f06758fc tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045624 Nov 28 20:44:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 367/1095] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:44:34 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:44:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] Creating event network-changed:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:44:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-14559bda-1e33-44e0-9bb9-85ffe0d7bd0b req-7583995e-c798-44d4-8476-29036f9c1f33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042983 Nov 28 20:44:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 365/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:44:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7e6418b6-7c6c-496e-a85d-c2dea0d195dc tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042337 Nov 28 20:44:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 365/1097] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:44:36 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] HTTP exception thrown: Instance 31463852-d5bb-4840-aa04-3bc48f95e03a is not attached to volume cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 Nov 28 20:44:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Returning 404 to user: Instance 31463852-d5bb-4840-aa04-3bc48f95e03a is not attached to volume cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:44:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-f2136ace-97a1-4e31-9376-3c49ec42fb04 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8" status: 404 len: 154 microversion: 2.1 time: 0.098855 Nov 28 20:44:36 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 368/1098] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:44:36 2023] DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a/os-volume_attachments/cf5d52ce-bbdd-42d3-b468-464c38dc7ab8 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:40 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:44:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1feab7c6-4819-4074-ac44-0b6b733ee2fa tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 204 len: 0 microversion: 2.1 time: 0.131385 Nov 28 20:44:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 366/1099] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:44:39 2023] DELETE /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "name": "network-vif-unplugged", "status": "completed", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:44:40 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a9546b6c4e84a5890b690340c414506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '335d61798b224867b31a4c78fcc33d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:44:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:40 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-9b10cdaf-6608-4c59-98ee-d4b0aa062c09 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 200 len: 1699 microversion: 2.1 time: 0.292353 Nov 28 20:44:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 366/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:44:40 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 1699 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:44:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] Creating event network-vif-unplugged:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:44:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-62a79265-7321-4ac2-864a-cadc143b6d58 req-40d9a7b8-dcc7-4943-8f75-b4fd4d68516a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031669 Nov 28 20:44:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 369/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:44:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:41 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:42 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:44:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-402a4337-10c3-41dd-90b9-e901a65c67b3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 200 len: 1544 microversion: 2.1 time: 0.389202 Nov 28 20:44:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 367/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:44:41 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 1544 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:44:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "name": "network-vif-plugged", "status": "completed", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}, {"server_uuid": "31463852-d5bb-4840-aa04-3bc48f95e03a", "name": "network-vif-deleted", "tag": "8a1dec1a-8918-4a7d-b090-5716c5b433e5"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:44:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:44:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:44:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:44:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Creating event network-vif-plugged:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:44:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] Creating event network-vif-deleted:8a1dec1a-8918-4a7d-b090-5716c5b433e5 for instance 31463852-d5bb-4840-aa04-3bc48f95e03a on user Nov 28 20:44:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-70575b8a-70f2-45a3-aa45-33535ffd68a3 req-cb9f78c6-1ed2-478d-8c3e-75b1047c65c3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028864 Nov 28 20:44:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 367/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:44:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=18 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-384a63b1-e9ae-4ab3-9dd7-5df8ea8f9591 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053902 Nov 28 20:45:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 370/1104] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:45:24 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:24 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:45:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-727331d1-2026-4508-ad78-f3ece6046c63 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 204 len: 0 microversion: 2.1 time: 0.119793 Nov 28 20:45:24 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 368/1105] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:45:24 2023] DELETE /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:45:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2a917bb6-bc87-429d-8962-eb5a0630c45c tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 200 len: 1674 microversion: 2.1 time: 0.317526 Nov 28 20:45:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 368/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:45:24 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 1674 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:45:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-unplugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] Creating event network-vif-unplugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:45:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-cff12130-e28a-4b79-b2dd-533c157b280c req-ba4fc750-e55d-4694-a57c-c4d92d62695c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045537 Nov 28 20:45:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 371/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:45:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-deleted", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] Creating event network-vif-deleted:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:45:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-38955dce-b51c-4bb5-a499-9b22ad948f2c req-8fb99a48-50cf-4d02-9763-42bd0dac017e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035743 Nov 28 20:45:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 369/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:45:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:27 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f23739ef-322e-4a8f-9df3-2a06e42b6a35", "name": "network-vif-plugged", "status": "completed", "tag": "7354a1a8-41e9-4a3c-9d08-fa55997c917a"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:27 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] Creating event network-vif-plugged:7354a1a8-41e9-4a3c-9d08-fa55997c917a for instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 on user Nov 28 20:45:27 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-aec940c2-b459-4f05-9efa-f137262ab526 req-2ff8487c-cc3a-415b-98b8-260f70932ffa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084285 Nov 28 20:45:27 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 369/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:45:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] [instance: 31463852-d5bb-4840-aa04-3bc48f95e03a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] HTTP exception thrown: Instance 31463852-d5bb-4840-aa04-3bc48f95e03a could not be found. Nov 28 20:45:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Returning 404 to user: Instance 31463852-d5bb-4840-aa04-3bc48f95e03a could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:45:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e1123884-72db-4272-9d54-7d4cdcba5db2 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a" status: 404 len: 111 microversion: 2.1 time: 0.031922 Nov 28 20:45:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 372/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:45:30 2023] GET /compute/v2.1/servers/31463852-d5bb-4840-aa04-3bc48f95e03a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:45:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b584b821-f0c3-4204-8504-2db36ee29f2d tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] Calling method '.version_select at 0x7f9e64128310>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b584b821-f0c3-4204-8504-2db36ee29f2d tempest-TestServerVolumeAttachScenarioOldVersion-2043532910 tempest-TestServerVolumeAttachScenarioOldVersion-2043532910-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-232633400" status: 202 len: 0 microversion: 2.1 time: 0.027466 Nov 28 20:45:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 370/1111] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:45:30 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-232633400 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:42 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:42 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-eae7c273-1ce5-4300-b5e9-fc20994e9fc9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.152455 Nov 28 20:45:42 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 370/1112] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:45:42 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-interface => generated 282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:42 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] Creating event network-changed:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:45:42 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-9f772ab8-90d9-4d55-9599-ba194d0535f0 req-44953a35-0102-45c7-b8f3-b52d83f0b954 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035002 Nov 28 20:45:42 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 373/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:45:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=12,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:43 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:43 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-8b34b84f-479f-4546-a1d0-16f029a3677b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/ips" status: 200 len: 108 microversion: 2.1 time: 0.048780 Nov 28 20:45:43 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 371/1114] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:45:43 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/ips => generated 108 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:45 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fe15ce31-ca15-4ce3-b1c5-f1d4e44a8542 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272741 Nov 28 20:45:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 371/1115] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:45:45 2023] POST /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8b462c9e-c094-4c2e-b92d-2dff19c6a3ba tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: .version_select at 0x7f9e644997e0>, body: {"keypair": {"name": "tempest-keypair-1035919865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEDDuxARll7/LMfz2HOhMx+h1egmbo8MLXcn8TDB+mNo/cPT/oI6Ezwve8HwnVYGVmMFb/zzID1OQQm1/7xa9jTN0HHpsL0zuCZQfCIjJiLFiEe+gATwmZBnGXhmgLGsJg=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:54 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8b462c9e-c094-4c2e-b92d-2dff19c6a3ba tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:45:54 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8b462c9e-c094-4c2e-b92d-2dff19c6a3ba tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:45:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8b462c9e-c094-4c2e-b92d-2dff19c6a3ba tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053188 Nov 28 20:45:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 374/1116] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:45:54 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-725689161", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7"}], "security_groups": [{"name": "tempest-securitygroup--1637327537"}], "key_name": "tempest-keypair-1035919865", "user_data": "}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] validate_networks() for [('1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:45:56 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:45:56 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c9059d44-571a-4339-923c-615e943c3349 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.571171 Nov 28 20:45:56 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 372/1117] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:45:56 2023] POST /compute/v2.1/servers => generated 400 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:45:56 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:56 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:45:56 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2594d5a8-e2ad-456f-a26a-473ccaf86717 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:45:56 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2594d5a8-e2ad-456f-a26a-473ccaf86717 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:45:56 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-2594d5a8-e2ad-456f-a26a-473ccaf86717 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:45:56 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2594d5a8-e2ad-456f-a26a-473ccaf86717 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 200 len: 1233 microversion: 2.1 time: 0.090029 Nov 28 20:45:56 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 372/1118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:45:56 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:45:58 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:45:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:45:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:45:58 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:45:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] Creating event network-changed:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:45:58 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-f8a1ba30-ced4-4a2b-af76-dca43f2efb2b req-723c809b-7381-4dbc-b63b-f8e9931f8d7f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050154 Nov 28 20:45:58 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 375/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:45:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:46:00 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "name": "network-vif-plugged", "status": "completed", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:46:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:00 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] Creating event network-vif-plugged:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:46:00 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-31dfb7a2-a5e4-4009-b6e7-3541b9d14582 req-348d1341-a788-46db-98b5-3597d7fa52af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028425 Nov 28 20:46:00 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 373/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:46:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:46:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "name": "network-vif-plugged", "status": "completed", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:46:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] Creating event network-vif-plugged:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:46:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a8fdd322-5641-4c0f-add5-18f040da3dd4 req-abe6b017-77e8-47e0-86a2-f94244771dff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030278 Nov 28 20:46:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 373/1121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:46:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: f23739ef-322e-4a8f-9df3-2a06e42b6a35] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HTTP exception thrown: Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 could not be found. Nov 28 20:46:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Returning 404 to user: Instance f23739ef-322e-4a8f-9df3-2a06e42b6a35 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:46:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-978e1534-6f35-4ac8-bcad-bb1883ff5d90 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35" status: 404 len: 111 microversion: 2.1 time: 0.035416 Nov 28 20:46:15 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 376/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:46:15 2023] GET /compute/v2.1/servers/f23739ef-322e-4a8f-9df3-2a06e42b6a35 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:46:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-741de418-5f07-4a5a-b677-2a613aaf051d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '.version_select at 0x7f9e5ff26050>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:46:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-741de418-5f07-4a5a-b677-2a613aaf051d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-249978267" status: 202 len: 0 microversion: 2.1 time: 0.032138 Nov 28 20:46:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 374/1123] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 20:46:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-249978267 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:22 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:46:22 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8b206ac3-c3f1-428e-8477-1d1623841180 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 204 len: 0 microversion: 2.1 time: 0.138090 Nov 28 20:46:22 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 374/1124] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:46:22 2023] DELETE /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:22 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-unplugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:46:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:22 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:46:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:22 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-07229579-f5d0-47d6-9759-24fb6e469690 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 200 len: 1495 microversion: 2.1 time: 0.263310 Nov 28 20:46:22 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 377/1125] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:46:22 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 1495 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:46:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] Creating event network-vif-unplugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:46:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-fee98269-c3e2-4784-9ea6-e56a23d69a1e req-3e25e319-4ddf-4bf9-80e7-5a1f60581f04 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055348 Nov 28 20:46:22 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 375/1126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:46:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:46:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-deleted", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:46:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:23 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] Creating event network-vif-deleted:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:46:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-a468c968-ad52-439d-bf2e-c0136cf722ce req-7fa80808-1061-465e-b63c-1b6716416f90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058614 Nov 28 20:46:23 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 375/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:46:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:46:24 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "def2369e-4d57-482b-aef9-dab7c3a7cb84", "name": "network-vif-plugged", "status": "completed", "tag": "ca71d400-500b-4d9b-9141-67afb25ac98d"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:46:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:24 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] Creating event network-vif-plugged:ca71d400-500b-4d9b-9141-67afb25ac98d for instance def2369e-4d57-482b-aef9-dab7c3a7cb84 on user Nov 28 20:46:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-35a368a6-c4bc-4442-a713-159625d652b5 req-f6783e3a-dba8-404c-b82e-c1e54b4c1b61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031423 Nov 28 20:46:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 378/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:46:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:46:46 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:46:47 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:46:47 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-14780692-bd76-4423-9b0e-ecf9f46f3a65 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 200 len: 1544 microversion: 2.1 time: 0.277771 Nov 28 20:46:47 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 376/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:46:46 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 1544 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:47:12 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:47:12 user devstack@n-api.service[65586]: Tue Nov 28 20:47:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 (ip 10.0.0.210) !!! Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: def2369e-4d57-482b-aef9-dab7c3a7cb84] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HTTP exception thrown: Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 could not be found. Nov 28 20:47:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Returning 404 to user: Instance def2369e-4d57-482b-aef9-dab7c3a7cb84 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:47:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1aba574f-c4c9-41d7-b257-d94be2ec83e6 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84" status: 404 len: 111 microversion: 2.1 time: 0.161034 Nov 28 20:47:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 376/1130] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:47:12 2023] GET /compute/v2.1/servers/def2369e-4d57-482b-aef9-dab7c3a7cb84 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:47:13 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:47:13 user devstack@n-api.service[65585]: Tue Nov 28 20:47:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f (ip 10.0.0.210) !!! Nov 28 20:47:13 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=10 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:47:13 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-483950a1-c1c9-4fd2-8a49-7e8a4b5015a3 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 204 len: 0 microversion: 2.1 time: 0.127063 Nov 28 20:47:13 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 379/1131] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:47:13 2023] DELETE /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '634123644067453a92f4d43da0b28fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd72dc075421c4e7eb9c0ff2bf1641a92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:47:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-788a8325-c86a-48e4-8f6d-d07c3aa6e90d tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 200 len: 1508 microversion: 2.1 time: 0.311247 Nov 28 20:47:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 377/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:47:13 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 1508 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:47:13 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-unplugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:13 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] Creating event network-vif-unplugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:47:13 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-be6c62f0-0746-4b10-a4c8-a400a9b1456a req-e4d2a50b-0c83-4829-85b3-db9ea928844b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095738 Nov 28 20:47:13 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 377/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-deleted", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:14 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 58560. Nov 28 20:47:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] Creating event network-vif-deleted:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:47:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-c2d3dad3-78fc-41ad-be09-c8afde0705d2 req-f90429cb-1fd8-4ded-9a00-7a18c98e4c50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036086 Nov 28 20:47:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 380/1134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29443f30-6d05-4148-9185-a31f78b4a68f", "name": "network-vif-plugged", "status": "completed", "tag": "ff9deee0-3665-4ae4-864e-1da67b83ccd2"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] Creating event network-vif-plugged:ff9deee0-3665-4ae4-864e-1da67b83ccd2 for instance 29443f30-6d05-4148-9185-a31f78b4a68f on user Nov 28 20:47:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-9881bcb2-5492-44a1-a354-e7b889c8dbab req-9c626976-d360-4310-a76e-9add79e205dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031645 Nov 28 20:47:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 378/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:47 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:47 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8ca68d1e-320c-42a8-b9fa-67866f768aa0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.205263 Nov 28 20:47:47 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 378/1136] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:47:47 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/os-interface => generated 283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] Creating event network-changed:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:47:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-948f89c7-291f-4937-a321-b9f6f9107735 req-aeb36cf8-5688-4a40-98c8-4051ebe3996d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039915 Nov 28 20:47:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 381/1137] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e5ba332a-31fc-422d-965a-31b6be264cb9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/ips" status: 200 len: 109 microversion: 2.1 time: 0.041365 Nov 28 20:47:48 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 379/1138] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:47:48 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/ips => generated 109 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Invalid volume: volume a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 is already attached to instances: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 400 to user: Invalid volume: volume a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 is already attached to instances: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:47:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e97e051a-cab0-4111-afaf-2631df660c00 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111286 Nov 28 20:47:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 379/1139] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:47:48 2023] POST /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:47:48 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-982da1c9-ec72-4f3c-8ac7-343e0d13b1cc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 204 len: 0 microversion: 2.1 time: 0.124380 Nov 28 20:47:48 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 382/1140] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:47:48 2023] DELETE /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "name": "network-vif-unplugged", "status": "completed", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:48 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] Creating event network-vif-unplugged:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:47:48 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-19198d05-5bbe-43d8-85fb-7428160f4017 req-425f70a1-4583-4792-98e7-c82c5cb23f1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032766 Nov 28 20:47:48 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 380/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 20:47:48 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:47:48 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-294fea1b-c158-4f80-912e-c4fd55e044a7 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 200 len: 1669 microversion: 2.1 time: 0.274887 Nov 28 20:47:48 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 380/1142] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:47:48 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:47:50 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "name": "network-vif-plugged", "status": "completed", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}, {"server_uuid": "876085ae-87cc-4a4d-b4b7-3f595497d6e7", "name": "network-vif-deleted", "tag": "2db490a9-4311-4a10-ba45-0610a87cb422"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:47:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:47:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:47:50 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:47:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Creating event network-vif-plugged:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:47:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] Creating event network-vif-deleted:2db490a9-4311-4a10-ba45-0610a87cb422 for instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 on user Nov 28 20:47:50 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-587c978a-b8ac-47cb-927a-d32c3969ebdb req-92aa76af-867b-4ed7-afdd-4464befb3a40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.095936 Nov 28 20:47:50 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 383/1143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:47:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=12 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] [instance: 29443f30-6d05-4148-9185-a31f78b4a68f] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] HTTP exception thrown: Instance 29443f30-6d05-4148-9185-a31f78b4a68f could not be found. Nov 28 20:48:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] Returning 404 to user: Instance 29443f30-6d05-4148-9185-a31f78b4a68f could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:48:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f3212672-207a-41f5-a65b-8c27e2bfe376 tempest-ServerRescueNegativeTestJSON-506941201 tempest-ServerRescueNegativeTestJSON-506941201-project-member] 10.0.0.210 "GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f" status: 404 len: 111 microversion: 2.1 time: 0.035874 Nov 28 20:48:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 381/1144] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:48:03 2023] GET /compute/v2.1/servers/29443f30-6d05-4148-9185-a31f78b4a68f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=10 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:48:39 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-629030a8-0f81-4481-8498-97eb1e5dd47f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 404 len: 111 microversion: 2.1 time: 0.043188 Nov 28 20:48:39 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 381/1145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:48:39 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:48:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-86cc637e-76b2-467a-ae40-60384533c680 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '.version_select at 0x7f9e64121120>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:48:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-86cc637e-76b2-467a-ae40-60384533c680 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035919865" status: 202 len: 0 microversion: 2.1 time: 0.059129 Nov 28 20:48:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 384/1146] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:48:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1035919865 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:39 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'services' on Instance uuid 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:48:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5175ded0-67bf-4929-8499-ac1833d9db20 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments/a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7" status: 202 len: 0 microversion: 2.1 time: 0.181442 Nov 28 20:48:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 382/1147] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:48:39 2023] DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments/a8cd7b78-4e23-4cef-bb9b-daf0904cf1a7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:48:39 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:48:40 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0872fc9d-a2a2-4db2-afee-d5de4de5d29f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052610 Nov 28 20:48:40 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 382/1148] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:48:39 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-cd666890-510e-418a-a226-06196e4f57b9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068190 Nov 28 20:49:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 385/1149] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:49:30 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:49:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-53b6d3a5-e14f-4611-b0a0-1443c180081b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 204 len: 0 microversion: 2.1 time: 0.112804 Nov 28 20:49:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 383/1150] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:49:30 2023] DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:49:30 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 20:49:30 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:49:30 user devstack@n-api.service[65587]: Tue Nov 28 20:49:30 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd (ip 10.0.0.210) !!! Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "name": "network-vif-unplugged", "status": "completed", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:30 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:49:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] Creating event network-vif-unplugged:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:49:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7855f3e2-b80b-4ebb-9302-914b2b5ff9e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 200 len: 1669 microversion: 2.1 time: 0.246496 Nov 28 20:49:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 383/1151] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:49:30 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 1669 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:49:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d887a0f2-4256-464d-a4af-afcf00d689cc req-e1cf7695-de6c-4829-8754-93c0dba4d911 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034424 Nov 28 20:49:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 386/1152] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:49:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:49:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "name": "network-vif-deleted", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:49:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] Creating event network-vif-deleted:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:49:32 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-6bc37faf-9b7e-4410-824a-522be8900529 req-cfbc83ec-5851-4def-92ea-136f590a3b6c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029475 Nov 28 20:49:32 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 384/1153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:49:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d47cb6-b685-4b05-a93b-7c9efdd3e4bd", "name": "network-vif-plugged", "status": "completed", "tag": "30bb67dc-9127-4518-917c-fa6fd887c49b"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:49:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:49:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:49:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:49:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] Creating event network-vif-plugged:30bb67dc-9127-4518-917c-fa6fd887c49b for instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd on user Nov 28 20:49:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-cdca7723-77c8-4252-8d8d-74a853a6ed49 req-bfb19a17-73c0-4007-a065-4439ac427ff4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046035 Nov 28 20:49:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 384/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:49:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. Nov 28 20:50:20 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:50:20 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-053eb330-cb71-4e81-a775-6e53de6acf7d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 404 len: 111 microversion: 2.1 time: 0.041998 Nov 28 20:50:20 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 387/1155] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:50:20 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:50:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8a7ca4d2-32c7-4558-a0d5-b6c86a316589 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '.version_select at 0x7f9e5fff0820>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:50:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8a7ca4d2-32c7-4558-a0d5-b6c86a316589 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067019178" status: 202 len: 0 microversion: 2.1 time: 0.034894 Nov 28 20:50:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 385/1156] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:50:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2067019178 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:50:21 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:50:21 user devstack@n-api.service[65587]: Tue Nov 28 20:50:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 28 20:50:21 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:50:21 user devstack@n-api.service[65587]: Tue Nov 28 20:50:21 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 28 20:50:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:21 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:50:21 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-7e95f90d-2f49-4cc8-942a-634044f71424 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: .version_select at 0x7f9e64242ef0>, body: {"keypair": {"name": "tempest-keypair-1955953124", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPzt+rvlu8IOwBMKEhMCcxSM5mRgkamAdD+fA49z5exaxi9GSu94u7hWGILlxAg7fxju8bk4UBIUtwAMFZ7Vzf1XpwpnQC9PZEkH0cOGYdYuiAGfClWnaAV61r4sPVb6xA=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:50:21 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 41302. Nov 28 20:50:21 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-7e95f90d-2f49-4cc8-942a-634044f71424 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:50:21 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-7e95f90d-2f49-4cc8-942a-634044f71424 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:50:21 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-7e95f90d-2f49-4cc8-942a-634044f71424 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064690 Nov 28 20:50:21 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 385/1157] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:50:21 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:50:22 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-556641452", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7"}], "security_groups": [{"name": "tempest-securitygroup--2085353983"}], "key_name": "tempest-keypair-1955953124", "user_data": "}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:50:22 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] validate_networks() for [('1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:50:23 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:50:23 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e6011048-a401-409e-9991-46b0c4911628 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.812779 Nov 28 20:50:23 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 388/1158] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:50:22 2023] POST /compute/v2.1/servers => generated 400 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:50:23 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-cb927de0-22b8-4d8e-a1df-8e8c9089aecf tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:50:23 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-cb927de0-22b8-4d8e-a1df-8e8c9089aecf tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:50:23 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-cb927de0-22b8-4d8e-a1df-8e8c9089aecf tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:50:23 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-cb927de0-22b8-4d8e-a1df-8e8c9089aecf tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 200 len: 1233 microversion: 2.1 time: 0.075302 Nov 28 20:50:23 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 386/1159] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:50:23 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 1233 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:50:25 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:50:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:25 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] Creating event network-changed:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:50:25 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-78bbebc8-e9fc-4e06-91c1-bb50e46c14ce req-07d81709-e1a8-48c6-a82e-ec616a2c4f2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086692 Nov 28 20:50:25 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 386/1160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:50:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:50:27 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "name": "network-vif-plugged", "status": "completed", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:50:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:27 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] Creating event network-vif-plugged:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:50:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-4eb5c4b7-808c-48c8-a9c4-32d0a4626d13 req-b2f01166-7956-4a69-90ca-4b344cb0eb44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038478 Nov 28 20:50:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 389/1161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:50:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:50:29 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "name": "network-vif-plugged", "status": "completed", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:50:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:50:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:50:29 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:50:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] Creating event network-vif-plugged:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:50:29 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-47c08a1a-11ff-4399-b2ef-18fe366ab088 req-60e3647a-8058-429a-a5e0-de19c4771cd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027594 Nov 28 20:50:29 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 387/1162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:50:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:51:13 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:51:13 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e6ffd3a1-97c0-4875-97a8-1335e07f40dc tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 200 len: 1544 microversion: 2.1 time: 0.299036 Nov 28 20:51:13 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 387/1163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:51:13 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 1544 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:52:13 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:52:13 user devstack@n-api.service[65585]: Tue Nov 28 20:52:13 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-interface (ip 10.0.0.210) !!! Nov 28 20:52:13 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:13 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d76ea0d1-31c2-4768-a155-3186031791f0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.186334 Nov 28 20:52:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 390/1164] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:52:13 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-interface => generated 283 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:52:14 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:52:14 user devstack@n-api.service[65586]: Tue Nov 28 20:52:14 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 20:52:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:14 user devstack@n-api.service[65586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 20:52:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-2e8fef89-e5b3-4012-b9b5-71e0827a18a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/ips" status: 200 len: 109 microversion: 2.1 time: 0.043233 Nov 28 20:52:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 388/1165] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:52:15 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:52:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:52:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] Creating event network-changed:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:52:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-264c0834-6da6-4d2e-b6e9-e741e816eaaa req-5879e60b-3460-48b0-a59e-ab080ec66afb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232634 Nov 28 20:52:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 388/1166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:52:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c63126b0-6d74-48cc-8d86-3448671163aa"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:17 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 33076. Nov 28 20:52:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-eeffbaf0-5a54-485f-b3b3-165b419f07d4 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313971 Nov 28 20:52:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 391/1167] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:52:17 2023] POST /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c63126b0-6d74-48cc-8d86-3448671163aa"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Invalid volume: volume c63126b0-6d74-48cc-8d86-3448671163aa is already attached to instances: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 Nov 28 20:52:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 400 to user: Invalid volume: volume c63126b0-6d74-48cc-8d86-3448671163aa is already attached to instances: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:52:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-67d17fe2-ea5e-4edc-b2c1-d54aa088f647 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.221079 Nov 28 20:52:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 389/1168] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:52:26 2023] POST /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments => generated 174 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:26 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52478. Nov 28 20:52:26 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'services' on Instance uuid 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:52:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-88bd7592-740d-444c-9b99-a15d98fc9e92 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments/c63126b0-6d74-48cc-8d86-3448671163aa" status: 202 len: 0 microversion: 2.1 time: 0.201409 Nov 28 20:52:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 389/1169] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:52:26 2023] DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments/c63126b0-6d74-48cc-8d86-3448671163aa => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:52:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:52:27 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9379d205-9ece-4912-af24-12d15860acf5 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046870 Nov 28 20:52:27 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 392/1170] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:52:26 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4f1ab355-1757-4afc-9b1c-7fa9ef3b842d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047284 Nov 28 20:53:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 390/1171] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:53:17 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:53:17 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:53:17 user devstack@n-api.service[65586]: Tue Nov 28 20:53:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 (ip 10.0.0.210) !!! Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:53:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e321790e-66df-4220-9c2e-d3b237d16350 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 204 len: 0 microversion: 2.1 time: 0.109501 Nov 28 20:53:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 390/1172] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:53:17 2023] DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:53:17 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:53:17 user devstack@n-api.service[65585]: Tue Nov 28 20:53:17 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 (ip 10.0.0.210) !!! Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:53:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-bcb05d30-e822-4f85-b41d-ec34c2142af0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 200 len: 1669 microversion: 2.1 time: 0.293730 Nov 28 20:53:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 393/1173] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:53:17 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 1669 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "name": "network-vif-unplugged", "status": "completed", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] Creating event network-vif-unplugged:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:53:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-cc5a78ad-c9a1-49a8-8736-6560f5791d90 req-8d985bb5-06bf-42b9-8fdc-3b201680d2c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032400 Nov 28 20:53:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 391/1174] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:53:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "name": "network-vif-plugged", "status": "completed", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}, {"server_uuid": "03e1aaf1-d8c2-4bc0-934b-00d8961cd368", "name": "network-vif-deleted", "tag": "e520ab2e-827e-49ed-974d-ab6828753ea6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:53:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:53:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:53:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:53:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Creating event network-vif-plugged:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:53:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] Creating event network-vif-deleted:e520ab2e-827e-49ed-974d-ab6828753ea6 for instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 on user Nov 28 20:53:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-57b49e97-2867-4c40-9797-4878dbf29008 req-4df741dd-ea04-4f59-8d3e-34b4d01578d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029619 Nov 28 20:53:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 391/1175] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. Nov 28 20:54:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:54:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0b93bb87-fdba-499c-a1d9-b25b8225f83a tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 404 len: 111 microversion: 2.1 time: 0.131409 Nov 28 20:54:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 394/1176] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:54:07 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:54:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c8555ab3-2872-4f11-ab29-dee5a4441f30 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '.version_select at 0x7f9e5ff24820>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:54:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c8555ab3-2872-4f11-ab29-dee5a4441f30 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955953124" status: 202 len: 0 microversion: 2.1 time: 0.031307 Nov 28 20:54:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 392/1177] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:54:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955953124 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:54:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:08 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:54:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2cc06a3b-c671-47e5-901f-9edb8f259547 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: .version_select at 0x7f9e641808b0>, body: {"keypair": {"name": "tempest-keypair-1778218187", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHiMPNWzL0GpLGIMPG/AmYmZDYonku5WZ9kUe5UoEMdM0LgTZPJ10hqZzhavjjCygbBzTBjxK1s3//CauBfe8IoR30/3vBxEKOW8ONxMGqZRbOdr5zCmmrmzgsS5dBSEDg=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:54:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-2cc06a3b-c671-47e5-901f-9edb8f259547 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:54:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-2cc06a3b-c671-47e5-901f-9edb8f259547 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:54:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2cc06a3b-c671-47e5-901f-9edb8f259547 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056687 Nov 28 20:54:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 392/1178] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 20:54:08 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:54:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1607459046", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "adminPass": "***", "networks": [{"uuid": "1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7"}], "security_groups": [{"name": "tempest-securitygroup--111684346"}], "key_name": "tempest-keypair-1778218187", "user_data": "}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] validate_networks() for [('1bc88abe-0c77-4a8e-91d0-f4f7cf3b8cd7', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Getting quotas for user 409bfc19d682425ea17eda9b336750b4 and project 9c30c6dea8b148f08d7e5e84757c5e64. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:54:10 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:54:10 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-c5f80b4c-0fa5-4274-b06e-9fc4904953d9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.567349 Nov 28 20:54:10 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 395/1179] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:54:09 2023] POST /compute/v2.1/servers => generated 399 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:54:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-14f51585-92e4-47f8-8acb-195fc6812459 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:54:10 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-14f51585-92e4-47f8-8acb-195fc6812459 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:54:10 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-14f51585-92e4-47f8-8acb-195fc6812459 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:54:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-14f51585-92e4-47f8-8acb-195fc6812459 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 200 len: 1234 microversion: 2.1 time: 0.074242 Nov 28 20:54:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 393/1180] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:54:10 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 1234 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:54:12 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:54:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:12 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] Creating event network-changed:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:54:12 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-602b583e-bf1c-46ab-838e-48e58a619f97 req-f2bd0754-b128-4bc0-ab19-93a412b20980 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028096 Nov 28 20:54:12 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 393/1181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:54:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:54:14 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:54:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:14 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:54:14 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-99e03513-ea13-4074-b8e8-4c14d0c54223 req-fcbc2652-2bd3-45e8-884d-89f1dad39e62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045522 Nov 28 20:54:14 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 396/1182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:54:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:54:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:54:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:54:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:54:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:54:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:54:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-e6f16a67-6f33-43b9-a3c7-7975380b0e02 req-ef166373-2ac4-423b-9e1c-8ffa3df32ebe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035695 Nov 28 20:54:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 394/1183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:54:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:55:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:55:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1a4349ad-637f-4301-8e3e-08b3e589fa14 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 200 len: 1543 microversion: 2.1 time: 0.295635 Nov 28 20:55:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 394/1184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:55:00 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 1543 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:56:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:00 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:01 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:01 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-de2d721f-4392-4432-a3cc-1acacda6d46b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.269867 Nov 28 20:56:01 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 397/1185] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 20:56:00 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-interface => generated 282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:02 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] Creating event network-changed:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:56:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-3e257274-3da1-4aaf-a431-db97afef8544 req-cfbe58ed-4bfc-432f-b81c-f2c76490e287 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127812 Nov 28 20:56:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 395/1186] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:56:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-edff0a22-d6de-4be1-9ce9-abec235c4f93 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/ips" status: 200 len: 108 microversion: 2.1 time: 0.043753 Nov 28 20:56:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 395/1187] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Nov 28 20:56:02 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/ips => generated 108 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47bb81e3-9c73-4fbc-9a7f-8b520613a18e"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3cd6af9f-425c-4dfc-8b1e-fbc8b22fc53d tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322283 Nov 28 20:56:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 398/1188] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 20:56:04 2023] POST /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:14 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 53188. Nov 28 20:56:14 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lazy-loading 'services' on Instance uuid 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 20:56:14 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-333ae7ae-158c-48fa-beea-55259e30bc99 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments/47bb81e3-9c73-4fbc-9a7f-8b520613a18e" status: 202 len: 0 microversion: 2.1 time: 0.205866 Nov 28 20:56:14 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 396/1189] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 20:56:14 2023] DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments/47bb81e3-9c73-4fbc-9a7f-8b520613a18e => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:56:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:56:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-14ddf6ac-4b5e-43e1-ba25-6d6fd34d86ac tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047286 Nov 28 20:56:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 396/1190] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:56:14 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:57:05 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:57:05 user devstack@n-api.service[65585]: Tue Nov 28 20:57:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 20:57:05 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:57:05 user devstack@n-api.service[65585]: Tue Nov 28 20:57:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3f0a46cf-977e-42cc-b491-bd961f0fd6e3 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064390 Nov 28 20:57:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 399/1191] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 20:57:05 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 20:57:05 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:57:05 user devstack@n-api.service[65587]: Tue Nov 28 20:57:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c (ip 10.0.0.210) !!! Nov 28 20:57:05 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 20:57:05 user devstack@n-api.service[65587]: Tue Nov 28 20:57:05 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c (ip 10.0.0.210) !!! Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 20:57:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-58f156e5-e374-42e5-90ee-c86e0ceb6c8b tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 204 len: 0 microversion: 2.1 time: 0.137346 Nov 28 20:57:05 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 397/1192] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:57:05 2023] DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409bfc19d682425ea17eda9b336750b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c30c6dea8b148f08d7e5e84757c5e64', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:57:05 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f6a77fde-8e72-4bf3-8d88-870947c92d62 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 200 len: 1667 microversion: 2.1 time: 0.298460 Nov 28 20:57:05 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 397/1193] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:57:05 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 1667 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-unplugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] Creating event network-vif-unplugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e8db0851-aade-4cb9-a1bc-30a590887e89 req-fb91d528-678b-49eb-88c6-87a6257664b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038483 Nov 28 20:57:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 400/1194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:57:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:57:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-deleted", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:57:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] Creating event network-vif-deleted:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-7d275fba-3a0c-4a4d-bf1f-6bf9fa0ad2b2 req-d717a411-ad5e-4a1e-a58d-1572800794f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Nov 28 20:57:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 398/1195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:57:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}, {"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}, {"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}, {"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-unplugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}, {"server_uuid": "5f3dfdce-64ea-48c3-a57d-6b21f4ef525c", "name": "network-vif-plugged", "status": "completed", "tag": "ffece4bb-9dc5-41f7-8ff2-9e097aac4a64"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:57:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:07 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Creating event network-vif-unplugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] Creating event network-vif-plugged:ffece4bb-9dc5-41f7-8ff2-9e097aac4a64 for instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c on user Nov 28 20:57:07 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-fb73a414-2b8b-4c2d-9605-1dce913fe264 req-5ebe0ff8-bfc7-45f9-a483-28aea24efa7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.030810 Nov 28 20:57:07 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 398/1196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:57:07 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:57:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. Nov 28 20:57:55 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:57:55 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-32b5a422-55df-4014-a252-3e13d93f1040 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 404 len: 111 microversion: 2.1 time: 0.039047 Nov 28 20:57:55 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 401/1197] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:57:55 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:57:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:57:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b1688a4e-9bbf-49bd-a2e1-4a0c2ac4912f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '.version_select at 0x7f9e5ff265f0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:57:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b1688a4e-9bbf-49bd-a2e1-4a0c2ac4912f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778218187" status: 202 len: 0 microversion: 2.1 time: 0.036869 Nov 28 20:57:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 399/1198] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 20:57:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1778218187 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. Nov 28 20:58:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-029f0b1c-7c16-4128-b2bc-09b92f865291 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 404 len: 111 microversion: 2.1 time: 0.034941 Nov 28 20:58:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 399/1199] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:58:02 2023] DELETE /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. Nov 28 20:58:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 5f3dfdce-64ea-48c3-a57d-6b21f4ef525c could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4119f91b-8195-4400-9c69-8ff0b47c22a0 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c" status: 404 len: 111 microversion: 2.1 time: 0.028869 Nov 28 20:58:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 402/1200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:58:02 2023] GET /compute/v2.1/servers/5f3dfdce-64ea-48c3-a57d-6b21f4ef525c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-330ed9ef-7310-48cf-b87d-2fd66399f664 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 404 len: 111 microversion: 2.1 time: 0.033122 Nov 28 20:58:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 400/1201] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:58:06 2023] DELETE /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 03e1aaf1-d8c2-4bc0-934b-00d8961cd368] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. Nov 28 20:58:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 03e1aaf1-d8c2-4bc0-934b-00d8961cd368 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a4d3ec33-01eb-4f4d-b017-0ca980b78bd9 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368" status: 404 len: 111 microversion: 2.1 time: 0.027311 Nov 28 20:58:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 400/1202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:58:06 2023] GET /compute/v2.1/servers/03e1aaf1-d8c2-4bc0-934b-00d8961cd368 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. Nov 28 20:58:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-20e08bcf-f539-46bd-9ed7-c12018cb0631 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 404 len: 111 microversion: 2.1 time: 0.033684 Nov 28 20:58:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 403/1203] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:58:06 2023] DELETE /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 876085ae-87cc-4a4d-b4b7-3f595497d6e7] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. Nov 28 20:58:06 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 876085ae-87cc-4a4d-b4b7-3f595497d6e7 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:06 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0154cd56-c7f9-4286-b3ee-7b914669264f tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7" status: 404 len: 111 microversion: 2.1 time: 0.030333 Nov 28 20:58:06 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 401/1204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:58:06 2023] GET /compute/v2.1/servers/876085ae-87cc-4a4d-b4b7-3f595497d6e7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. Nov 28 20:58:09 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7a5060c7-f8c2-4a80-8094-7c1cbcee4573 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 404 len: 111 microversion: 2.1 time: 0.027806 Nov 28 20:58:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 401/1205] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 20:58:09 2023] DELETE /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] [instance: 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] HTTP exception thrown: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. Nov 28 20:58:09 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] Returning 404 to user: Instance 99d47cb6-b685-4b05-a93b-7c9efdd3e4bd could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 20:58:09 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-7cfd44d9-6270-4c4d-922c-223cee975039 tempest-AttachVolumeNegativeTest-959194587 tempest-AttachVolumeNegativeTest-959194587-project-member] 10.0.0.210 "GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd" status: 404 len: 111 microversion: 2.1 time: 0.030360 Nov 28 20:58:09 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 404/1206] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:58:09 2023] GET /compute/v2.1/servers/99d47cb6-b685-4b05-a93b-7c9efdd3e4bd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 20:58:43 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1315081543", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "f58f419e-07c4-4922-a817-af480095646a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:58:43 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:43 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 20:58:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 20:58:45 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f58f419e-07c4-4922-a817-af480095646a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 20:58:45 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c2a4e241-1b56-4302-971f-053469b38091 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.309945 Nov 28 20:58:45 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 402/1207] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 20:58:43 2023] POST /compute/v2.1/servers => generated 378 bytes in 1312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 20:58:45 user devstack@n-api.service[65586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 20:58:45 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3434b698-c8ac-4a18-90dd-29c24c68a7c4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:58:45 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3434b698-c8ac-4a18-90dd-29c24c68a7c4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:58:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:45 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:45 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-3434b698-c8ac-4a18-90dd-29c24c68a7c4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:58:45 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3434b698-c8ac-4a18-90dd-29c24c68a7c4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 200 len: 1050 microversion: 2.1 time: 0.065553 Nov 28 20:58:45 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 402/1208] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:58:45 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 1050 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:58:47 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:58:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] Creating event network-changed:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 20:58:47 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e42db2d2-6787-438a-ace8-61adcc12d940 req-bccb3b20-824e-4082-b3b1-15b704c19b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040021 Nov 28 20:58:47 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 405/1209] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:58:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "name": "network-vif-plugged", "status": "completed", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:59:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:59:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] Creating event network-vif-plugged:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 20:59:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-04527119-32ef-4342-b74a-82d03453ef73 req-4a46a041-fece-46f5-8c16-efda22ea5123 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065018 Nov 28 20:59:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 403/1210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:59:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "name": "network-vif-plugged", "status": "completed", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:59:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:59:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] Creating event network-vif-plugged:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 20:59:03 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-050b2c3e-164b-4457-b29c-ec6d41fc2e13 req-2b55a7ac-eac6-4688-b869-daed3a204577 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060093 Nov 28 20:59:03 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 403/1211] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 20:59:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 20:59:35 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 20:59:35 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4d3a2a1e-7124-42c2-aa73-f78a96ae7326 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 200 len: 1376 microversion: 2.1 time: 0.198608 Nov 28 20:59:35 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 406/1212] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 20:59:35 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 1376 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:00:35 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 21:00:35 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:00:35 user devstack@n-api.service[65587]: Tue Nov 28 21:00:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee (ip 10.0.0.210) !!! Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:35 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:00:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-494cfcb6-b361-4b26-baf1-b6a344e2879f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 200 len: 1376 microversion: 2.1 time: 0.270868 Nov 28 21:00:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 404/1213] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:00:35 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 1376 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:35 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:00:35 user devstack@n-api.service[65586]: Tue Nov 28 21:00:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee (ip 10.0.0.210) !!! Nov 28 21:00:35 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:00:35 user devstack@n-api.service[65586]: Tue Nov 28 21:00:35 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee (ip 10.0.0.210) !!! Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:35 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57176. Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:35 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:00:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-89d6ae41-d436-4a39-a5e2-84f0eb277777 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 200 len: 1376 microversion: 2.1 time: 0.277592 Nov 28 21:00:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 404/1214] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:00:35 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 1376 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:00:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-005e27ee-7dd0-466b-9f3a-acbd06feb7d5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 204 len: 0 microversion: 2.1 time: 0.125151 Nov 28 21:00:36 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 407/1215] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:00:36 2023] DELETE /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:00:36 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a8435d46-d166-47d6-bb42-01503ef2caf4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 200 len: 1382 microversion: 2.1 time: 0.192771 Nov 28 21:00:36 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 405/1216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:00:36 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 1382 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:00:36 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:00:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:36 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] Creating event network-vif-unplugged:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 21:00:36 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-24c598e3-298b-4564-b411-7420a0d169fc req-675146a3-24e9-4766-87ed-cc08936dbeea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031237 Nov 28 21:00:36 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 405/1217] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:00:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:00:38 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "name": "network-vif-plugged", "status": "completed", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}, {"server_uuid": "523bbab2-2a04-4bf9-9318-d80922e55cee", "name": "network-vif-deleted", "tag": "3e8f3c87-f107-471d-ab79-72568b1b5e25"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:00:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:00:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:00:38 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:00:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Creating event network-vif-plugged:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 21:00:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] Creating event network-vif-deleted:3e8f3c87-f107-471d-ab79-72568b1b5e25 for instance 523bbab2-2a04-4bf9-9318-d80922e55cee on user Nov 28 21:00:38 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6b6f2382-43d7-4c29-9d11-4b7634c1e82b req-681beefd-072f-43b5-abdc-a951efa0dea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032235 Nov 28 21:00:38 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 408/1218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:00:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=12 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34074. Nov 28 21:01:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. Nov 28 21:01:26 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:01:26 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0d678203-c319-4eaf-936a-32344c4dd0d8 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 404 len: 111 microversion: 2.1 time: 0.041636 Nov 28 21:01:26 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 406/1219] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:01:26 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. Nov 28 21:01:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:01:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-cd7d4607-110e-4805-a122-31eae29ab59e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 404 len: 111 microversion: 2.1 time: 0.030849 Nov 28 21:01:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 406/1220] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:01:26 2023] DELETE /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 523bbab2-2a04-4bf9-9318-d80922e55cee] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. Nov 28 21:01:26 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 523bbab2-2a04-4bf9-9318-d80922e55cee could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:01:26 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a3240b78-2f8e-480d-a809-d227c6434b23 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee" status: 404 len: 111 microversion: 2.1 time: 0.037959 Nov 28 21:01:26 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 409/1221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:01:26 2023] GET /compute/v2.1/servers/523bbab2-2a04-4bf9-9318-d80922e55cee => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:01:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e5192e2d-03fd-4e1f-a5b2-ddf980a66608 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: .version_select at 0x7f9e5ff25c60>, body: {"keypair": {"name": "tempest-keypair-873960613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/MkJk8yOJyVUDVMSAWkILaxwFgsrVHs1ekfKqJM0WoG/ObKz6549Z0YYDm+bA8H8MBa8yAktgYF0rT6LZ6SK2UGBhV/y9bcPH66+bXDNUd0nVL6S+nhT0itdm9L2qOsQ=="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:01:38 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:01:38 user devstack@n-api.service[65587]: Tue Nov 28 21:01:38 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 28 21:01:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:38 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-e5192e2d-03fd-4e1f-a5b2-ddf980a66608 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:01:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-e5192e2d-03fd-4e1f-a5b2-ddf980a66608 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:01:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e5192e2d-03fd-4e1f-a5b2-ddf980a66608 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065243 Nov 28 21:01:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 407/1222] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 21:01:38 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-529793188", "imageRef": "", "flavorRef": "1", "block_device_mapping_v2": [{"uuid": "77bb07d6-673c-4282-b7e5-67a6ddc8d808", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}], "security_groups": [{"name": "tempest-securitygroup--1797901152"}], "key_name": "tempest-keypair-873960613", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:01:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='77bb07d6-673c-4282-b7e5-67a6ddc8d808',volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:01:40 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-320890cd-e34f-42a5-9fdc-f7fab5a29788 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.740333 Nov 28 21:01:40 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 407/1223] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:01:39 2023] POST /compute/v2.1/servers => generated 404 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:01:40 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-567882be-ad38-48df-8859-29cb6ff6164b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:01:40 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-567882be-ad38-48df-8859-29cb6ff6164b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:01:40 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:40 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:40 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-567882be-ad38-48df-8859-29cb6ff6164b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:01:40 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-567882be-ad38-48df-8859-29cb6ff6164b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 200 len: 1086 microversion: 2.1 time: 0.132637 Nov 28 21:01:40 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 410/1224] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:01:40 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 1086 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:01:42 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:01:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:42 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] Creating event network-changed:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:01:42 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-25fde031-b444-4116-b882-90821d4f0365 req-e51d8cc7-5cc1-4751-adf0-8e36bd0a5714 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093716 Nov 28 21:01:42 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 408/1225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:01:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "name": "network-vif-plugged", "status": "completed", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:50 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] Creating event network-vif-plugged:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:01:50 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-80790c22-2421-4231-991d-de3be62c55ca req-1bc65d30-be63-47fb-bd57-b2c88da62d4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040163 Nov 28 21:01:50 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 408/1226] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:01:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "name": "network-vif-plugged", "status": "completed", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:01:53 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:01:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] Creating event network-vif-plugged:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:01:53 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-d147cc5f-638f-414d-ab4c-8c69cb799dc7 req-71073e14-11a6-4fbd-afe0-440aa5e69eb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036312 Nov 28 21:01:53 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 411/1227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:01:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:02:30 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:02:30 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3d4b71bf-7913-47c3-80d8-bc4f9f7b2045 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 200 len: 1439 microversion: 2.1 time: 0.270057 Nov 28 21:02:30 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 409/1228] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:02:30 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 1439 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-e2a0674d-d2cd-467b-938f-25f7d31ebb32 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.160597 Nov 28 21:03:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 409/1229] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 21:03:30 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/os-interface => generated 283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:03:31 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] Creating event network-changed:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:03:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-6d301f40-293b-43df-8210-8025e439d5a6 req-8541a4e4-2fb9-44c4-94f7-9ad5fbe840e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193326 Nov 28 21:03:31 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 412/1230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:03:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:32 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:03:32 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-40d7ceb9-6cfe-4f6c-b82d-80e60f057d14 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 200 len: 1558 microversion: 2.1 time: 0.289669 Nov 28 21:03:32 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 410/1231] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:03:32 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 1558 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1468595788"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:32 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:33 user devstack@n-api.service[65586]: INFO nova.compute.api [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Attempting to quiesce instance before volume snapshot. Nov 28 21:03:33 user devstack@n-api.service[65586]: INFO nova.compute.api [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Skipping quiescing instance: QEMU guest agent is not enabled. Nov 28 21:03:33 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Creating snapshot from volume 77bb07d6-673c-4282-b7e5-67a6ddc8d808. {{(pid=65586) snapshot_instance /opt/stack/nova/nova/compute/api.py:3512}} Nov 28 21:03:35 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-f3fc2396-fc93-42e8-87a7-57025124fd01 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/action" status: 202 len: 0 microversion: 2.1 time: 2.632921 Nov 28 21:03:35 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 410/1232] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Nov 28 21:03:32 2023] POST /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008/action => generated 0 bytes in 2634 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Nov 28 21:03:36 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8064a372-a15f-45d4-a714-53f534de7ea5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: .version_select at 0x7f9e64123c70>, body: {"keypair": {"name": "tempest-keypair-1255583566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMf2ys1XQYYretN2P0dIu5wFF+MXALvH7zK0bbIOgyhUxST+CUXGnbDQroRw6gXDf2nrzmq0MgeyBR1God057nVDYNWRKaTGZwtUot9+e9ipYZq6EKK2CYFICRpb1AqBtA=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:36 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36696. Nov 28 21:03:36 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8064a372-a15f-45d4-a714-53f534de7ea5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:03:36 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-8064a372-a15f-45d4-a714-53f534de7ea5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:03:36 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8064a372-a15f-45d4-a714-53f534de7ea5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057325 Nov 28 21:03:36 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 413/1233] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 21:03:36 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-108070366", "imageRef": "a501c866-c0be-4693-84f0-15759ab42ff6", "flavorRef": "1", "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}], "security_groups": [{"name": "tempest-securitygroup--1828168308"}], "key_name": "tempest-keypair-1255583566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:03:38 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='af2408f6-5ac6-41ae-bb41-d186572a1c9c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:03:38 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-1aa7528a-8ef6-4ccb-94c5-db24bf2e75cd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.595264 Nov 28 21:03:38 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 411/1234] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:03:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:03:38 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-43c1daa3-a223-4260-9488-ad29b5b047f3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:03:38 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-43c1daa3-a223-4260-9488-ad29b5b047f3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:03:38 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-43c1daa3-a223-4260-9488-ad29b5b047f3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:03:38 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-43c1daa3-a223-4260-9488-ad29b5b047f3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 200 len: 1245 microversion: 2.1 time: 0.062967 Nov 28 21:03:38 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 411/1235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:03:38 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 1245 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:03:41 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:41 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] Creating event network-changed:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:03:41 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3d7d91d1-0dac-4c60-a4b9-14650b55a2ce req-86fa75e4-75f8-45f7-ae51-61178a0f4507 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030834 Nov 28 21:03:41 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 414/1236] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=8 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "name": "network-vif-plugged", "status": "completed", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:55 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] Creating event network-vif-plugged:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:03:55 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-eb59cde7-c137-44a3-8dbb-8bebe2ddeb21 req-81e1024e-baa0-4a63-a5fd-9bca2940e8d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039715 Nov 28 21:03:55 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 412/1237] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:03:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "name": "network-vif-plugged", "status": "completed", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=18,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:03:57 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:03:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] Creating event network-vif-plugged:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:03:57 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-925ba2e1-a314-4a94-ba2f-1a1150af069f req-a450348a-0cea-46aa-b975-dd95733fc5c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049739 Nov 28 21:03:57 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 412/1238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:03:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:04:28 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:04:29 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:04:29 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-df936e8e-038c-4dc8-9137-80fc1543543e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 200 len: 1597 microversion: 2.1 time: 0.214082 Nov 28 21:04:29 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 415/1239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:04:28 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 1597 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:05:29 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-64263f49-5039-4902-9fd7-46e583e54dd2 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.409824 Nov 28 21:05:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 413/1240] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 21:05:29 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586/os-interface => generated 282 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:30 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] Creating event network-changed:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:05:30 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-db4b89f2-ed78-46d5-a569-9e755653d616 req-e85b57c2-ee77-44c6-af60-492bc677369b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147841 Nov 28 21:05:30 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 413/1241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:05:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:30 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:05:30 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-809f043b-0631-4492-b077-39c62d087b1a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 200 len: 1597 microversion: 2.1 time: 0.346912 Nov 28 21:05:30 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 416/1242] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:05:30 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 1597 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:30 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52290. Nov 28 21:05:30 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:05:31 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-a51f49cb-087a-4e4b-9d99-d23d05666891 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 204 len: 0 microversion: 2.1 time: 0.151114 Nov 28 21:05:31 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 414/1243] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:05:30 2023] DELETE /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:31 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "name": "network-vif-unplugged", "status": "completed", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:05:31 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:05:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:31 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:31 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-733798e4-2e15-473a-814d-cb967124d893 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 200 len: 1721 microversion: 2.1 time: 0.292012 Nov 28 21:05:31 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 414/1244] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:05:31 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:05:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] Creating event network-vif-unplugged:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:05:31 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e23c8333-2abb-4680-b118-e8b4f3cbbae1 req-99eb7c9a-c1de-45a4-80f5-a26b5b81a746 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058825 Nov 28 21:05:31 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 417/1245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:05:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:05:33 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "name": "network-vif-plugged", "status": "completed", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:05:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:33 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] Creating event network-vif-plugged:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:05:33 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-dbfaa076-442b-4bca-ae6e-a1be807da8b0 req-fbd891a9-ef57-4110-8743-c9edc6fff9a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030845 Nov 28 21:05:33 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 415/1246] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:05:33 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64096bfc-b1c0-4bdb-8268-64568428f586", "name": "network-vif-deleted", "tag": "666c4820-03e7-4bf8-9a14-a14f7e9e70e6"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:05:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:05:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:05:33 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:05:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] Creating event network-vif-deleted:666c4820-03e7-4bf8-9a14-a14f7e9e70e6 for instance 64096bfc-b1c0-4bdb-8268-64568428f586 on user Nov 28 21:05:33 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-84bc88c0-2a45-41f8-ab11-08770e8c0861 req-3e33b786-0263-433f-81a4-0c0faceb996c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027016 Nov 28 21:05:33 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 415/1247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:05:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=8 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. Nov 28 21:06:21 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:06:21 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1f4e3d53-b2c1-49bd-9e4f-72c2756ca078 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 404 len: 111 microversion: 2.1 time: 0.054138 Nov 28 21:06:21 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 418/1248] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:06:21 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:24 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:06:24 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-84a88c6f-195c-4eab-a4de-48e3c4d1bfbe tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 204 len: 0 microversion: 2.1 time: 0.125362 Nov 28 21:06:24 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 416/1249] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:06:24 2023] DELETE /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=10 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:25 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "name": "network-vif-unplugged", "status": "completed", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:06:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:25 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] Creating event network-vif-unplugged:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:06:25 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-3685d617-3ff6-4a8f-8296-681381b7b612 req-69b18184-2b77-40ac-acd9-09f3fc1fcc47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035008 Nov 28 21:06:25 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 419/1250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:06:25 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:06:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-a9e54f54-b4ba-4a97-a35f-b27855ffb1fd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 200 len: 1564 microversion: 2.1 time: 0.333231 Nov 28 21:06:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 416/1251] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:06:24 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 1564 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:06:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "name": "network-vif-plugged", "status": "completed", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}, {"server_uuid": "95a5bda9-0bab-43f3-a77b-9dbfde4c0008", "name": "network-vif-deleted", "tag": "e36f67df-c2a4-4e01-802a-15cbb22e1cf8"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:06:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:06:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:06:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:06:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Creating event network-vif-plugged:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:06:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] Creating event network-vif-deleted:e36f67df-c2a4-4e01-802a-15cbb22e1cf8 for instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 on user Nov 28 21:06:27 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-1d12ed48-d4df-4380-b740-ee03775a1b1e req-199df33d-a44e-493b-bdf8-7917f3d3a315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030324 Nov 28 21:06:27 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 417/1252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:06:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:07:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0076dd7c-d886-42a5-abd2-528d404e23e6 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 404 len: 111 microversion: 2.1 time: 0.034303 Nov 28 21:07:15 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 420/1253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:07:15 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. Nov 28 21:07:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:07:15 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-ac7399b6-c15b-4039-ad97-e75830c5df2f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 404 len: 111 microversion: 2.1 time: 0.029074 Nov 28 21:07:15 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 417/1254] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:07:15 2023] DELETE /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 64096bfc-b1c0-4bdb-8268-64568428f586] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. Nov 28 21:07:15 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 64096bfc-b1c0-4bdb-8268-64568428f586 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:07:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-0c929767-28d4-48e5-8bea-5673a5680690 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586" status: 404 len: 111 microversion: 2.1 time: 0.035339 Nov 28 21:07:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 418/1255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:07:15 2023] GET /compute/v2.1/servers/64096bfc-b1c0-4bdb-8268-64568428f586 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:07:15 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-32d1ea64-1973-45ca-ba68-85c525184b09 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '.version_select at 0x7f9e64171bd0>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:15 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-32d1ea64-1973-45ca-ba68-85c525184b09 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255583566" status: 202 len: 0 microversion: 2.1 time: 0.027104 Nov 28 21:07:15 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 421/1256] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 21:07:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1255583566 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:07:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3ff6b210-f736-414f-a7e3-c38ccad344cb tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 404 len: 111 microversion: 2.1 time: 0.052855 Nov 28 21:07:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 418/1257] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:07:16 2023] DELETE /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 95a5bda9-0bab-43f3-a77b-9dbfde4c0008] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. Nov 28 21:07:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 95a5bda9-0bab-43f3-a77b-9dbfde4c0008 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:07:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-28e5ad50-16b2-46bb-b798-c134ae46fa9e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008" status: 404 len: 111 microversion: 2.1 time: 0.026539 Nov 28 21:07:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 419/1258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:07:16 2023] GET /compute/v2.1/servers/95a5bda9-0bab-43f3-a77b-9dbfde4c0008 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:07:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-0aaeef1a-7af5-4e6d-8f13-0644e57c5efd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '.version_select at 0x7f9e64173370>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-0aaeef1a-7af5-4e6d-8f13-0644e57c5efd tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-873960613" status: 202 len: 0 microversion: 2.1 time: 0.020612 Nov 28 21:07:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 422/1259] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Nov 28 21:07:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-873960613 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-6ca297cf-74ca-4326-8f1d-81ae61eedd86 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: .version_select at 0x7f9e5fe49870>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-71941204", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGBrnh5f2cItdPfJzsexfZNk2hdyXzj152ZtqQ9Dor6rVz8HgZT9NNlrjLjwllNv6HIex4SrodZhI/wURy2F3kX7ieRaGyNBcRFhM7hNUlDgud3W2BORHw9s0Uz7PxaoQ=="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-6ca297cf-74ca-4326-8f1d-81ae61eedd86 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:07:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-6ca297cf-74ca-4326-8f1d-81ae61eedd86 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'key_pairs'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:07:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-6ca297cf-74ca-4326-8f1d-81ae61eedd86 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.060297 Nov 28 21:07:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 419/1260] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 21:07:16 2023] POST /compute/v2.1/os-keypairs => generated 398 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1869233185", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1612294915"}], "block_device_mapping_v2": [{"uuid": "dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-71941204", "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}]}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.network.neutron [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65587) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.virt.hardware [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65587) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.quota [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65587) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65587) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:07:23 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5',volume_size=None,volume_type=None)] {{(pid=65587) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:07:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9d332827-eb08-4ee1-bf7b-5218e7457c7b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.812580 Nov 28 21:07:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 420/1261] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:07:23 2023] POST /compute/v2.1/servers => generated 404 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:07:23 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-19b0c0ad-353a-4520-b18a-10bfd1b20cd3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:07:23 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-19b0c0ad-353a-4520-b18a-10bfd1b20cd3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:07:24 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-19b0c0ad-353a-4520-b18a-10bfd1b20cd3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:07:24 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-19b0c0ad-353a-4520-b18a-10bfd1b20cd3 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 200 len: 1086 microversion: 2.1 time: 0.113040 Nov 28 21:07:24 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 423/1262] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:07:23 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 1086 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:07:26 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:26 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:07:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:26 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] Creating event network-changed:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:07:26 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-e5bcc947-98b5-415c-9c77-46b66629f61f req-ec5c5c4f-7d84-42e1-bd13-0b12e3258e61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145336 Nov 28 21:07:26 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 420/1263] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:07:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "name": "network-vif-plugged", "status": "completed", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:35 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] Creating event network-vif-plugged:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:07:35 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-ef55ee7b-5507-4960-bb9b-78e7a5c54679 req-ea989c3e-758c-40b8-9b34-313dd66be141 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040512 Nov 28 21:07:35 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 421/1264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:07:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "name": "network-vif-plugged", "status": "completed", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:07:37 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:07:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] Creating event network-vif-plugged:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:07:37 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-514a6c5f-5932-4dc7-93b0-b03bbac786f8 req-41b9f5c7-51dd-49e3-ad41-26bda40a1d3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Nov 28 21:07:37 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 424/1265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:07:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:08:14 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:08:14 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-88f11349-cbc2-4174-bd3e-818f8180d20d tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 200 len: 1438 microversion: 2.1 time: 0.258064 Nov 28 21:08:14 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 421/1266] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:08:14 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 1438 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:14 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:15 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:09:15 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-c5820adb-e691-451f-8b7a-307c0b15fd54 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 200 len: 1438 microversion: 2.1 time: 0.638456 Nov 28 21:09:15 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 422/1267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:09:14 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 1438 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:09:16 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:16 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] Creating event network-changed:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:09:16 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-e8d32861-c6eb-4874-8447-cb33983c26a3 req-3556313a-4ef9-497f-8ea8-123c0fdaa0bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126288 Nov 28 21:09:16 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 425/1268] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:17 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Going to try to terminate instance {{(pid=65586) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:09:17 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-905d0840-04ea-4226-8ca3-5c87401ec7f4 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 204 len: 0 microversion: 2.1 time: 0.134108 Nov 28 21:09:17 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 422/1269] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:09:17 2023] DELETE /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:17 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:09:17 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-de98d83b-bd5e-438a-b716-31f957229b95 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 200 len: 1444 microversion: 2.1 time: 0.176652 Nov 28 21:09:17 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 423/1270] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:09:17 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 1444 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:09:17 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "name": "network-vif-unplugged", "status": "completed", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:09:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:17 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] Creating event network-vif-unplugged:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:09:17 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-c8e69497-56c9-425a-9a31-5d6c03008a8d req-1b7fdb73-4115-4c83-9fcf-4f52e2d7774b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101527 Nov 28 21:09:17 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 426/1271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:09:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:09:19 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "name": "network-vif-deleted", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:09:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:19 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] Creating event network-vif-deleted:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:09:19 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-64fe23f3-8b12-45df-886a-282417a75706 req-37c9c1f9-4ff9-426a-b1a7-8cbb989ade8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029769 Nov 28 21:09:19 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 423/1272] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:09:19 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86ee3671-369b-4689-aad8-6d6dae45e786", "name": "network-vif-plugged", "status": "completed", "tag": "38a62a74-cd61-47f8-9fae-c2e1a372cebe"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:09:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:09:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:09:19 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:09:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] Creating event network-vif-plugged:38a62a74-cd61-47f8-9fae-c2e1a372cebe for instance 86ee3671-369b-4689-aad8-6d6dae45e786 on user Nov 28 21:09:19 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-b668907b-6774-42c5-8a05-f8cb25028638 req-72e8895b-8b6f-4c75-9992-78727a24b0a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082186 Nov 28 21:09:19 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 424/1273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:10:07 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 21:10:07 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 21:10:07 user devstack@n-api.service[65585]: Tue Nov 28 21:10:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 (ip 10.0.0.210) !!! Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. Nov 28 21:10:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:10:07 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a2d785e4-42db-4e55-bcee-fd92a1c97b9c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 404 len: 111 microversion: 2.1 time: 0.040034 Nov 28 21:10:07 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 427/1274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:10:07 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:10:07 user devstack@n-api.service[65586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:10:07 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:07 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:07 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-30267068", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1612294915"}], "block_device_mapping_v2": [{"uuid": "dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-71941204", "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}]}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:10:08 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57272. Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:10:08 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:10:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:10:09 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dc03c5f8-5cd4-4ff2-99c4-0553fa5483d5',volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:10:09 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1abf0546-6370-4d74-bd97-4767e634d96e tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.768782 Nov 28 21:10:09 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 424/1275] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:10:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:10:09 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-bd209eb4-be2d-4b21-b638-5dbfa36b7859 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:10:09 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-bd209eb4-be2d-4b21-b638-5dbfa36b7859 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:10:09 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 28 21:10:09 user devstack@n-api.service[65587]: Tue Nov 28 21:10:09 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 (ip 10.0.0.210) !!! Nov 28 21:10:09 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:09 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=14 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:09 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-bd209eb4-be2d-4b21-b638-5dbfa36b7859 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:10:09 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-bd209eb4-be2d-4b21-b638-5dbfa36b7859 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 200 len: 1084 microversion: 2.1 time: 0.116765 Nov 28 21:10:09 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 425/1276] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:10:09 2023] GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 1084 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:10:12 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 57276. Nov 28 21:10:12 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:10:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:12 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] Creating event network-changed:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:10:12 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-75eff6b5-5d2b-4afd-8387-6a9c94817f5b req-6e9489c7-d58b-4c64-8675-e8c663347d7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102399 Nov 28 21:10:12 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 428/1277] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:10:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "name": "network-vif-plugged", "status": "completed", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:20 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] Creating event network-vif-plugged:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:10:20 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-27c32c30-c28a-457e-936e-7f7ba2fe9c67 req-0ed03ad7-927e-4dc0-9dd2-ff18bc17e034 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037421 Nov 28 21:10:20 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 425/1278] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "name": "network-vif-plugged", "status": "completed", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:22 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] Creating event network-vif-plugged:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:10:22 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-283eee22-2fef-41ea-baaa-d7f1389a057f req-dbcf44a9-0071-4300-9968-0ccf61c40d63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039017 Nov 28 21:10:22 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 426/1279] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:10:59 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:10:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9b55461f-27b8-47bc-b1c5-9606b07db823 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 200 len: 1437 microversion: 2.1 time: 0.310295 Nov 28 21:10:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 429/1280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:10:59 2023] GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 1437 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:12:00 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:12:00 user devstack@n-api.service[65586]: Tue Nov 28 21:12:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 (ip 10.0.0.210) !!! Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:00 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:12:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-2037f0fb-b90d-424f-8423-f9dfabb0fff5 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 200 len: 1437 microversion: 2.1 time: 0.235953 Nov 28 21:12:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 426/1281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:12:00 2023] GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 1437 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:01 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] Creating event network-changed:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:12:01 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-72dc2f69-770f-4f76-a12d-bc9bbeb11e5a req-657fa74d-88b6-4bf1-a9dd-bc175511f43b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044613 Nov 28 21:12:01 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 427/1282] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:12:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:12:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1387928385", "imageRef": "", "flavorRef": "1", "security_groups": [{"name": "tempest-secgroup-smoke-1612294915"}], "block_device_mapping_v2": [{"uuid": "a7f5b340-dde9-4f11-8bcb-6acd0411e24d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "key_name": "tempest-TestVolumeBootPattern-71941204", "networks": [{"uuid": "6aea05c0-0b8e-4107-98d9-b57f711770c7"}]}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:12:07 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:12:07 user devstack@n-api.service[65585]: Tue Nov 28 21:12:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Nov 28 21:12:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.network.neutron [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] validate_networks() for [('6aea05c0-0b8e-4107-98d9-b57f711770c7', None, None, None, None, None)] {{(pid=65585) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image limits 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Flavor pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Image pref 0:0:0 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.virt.hardware [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Getting quotas for user fc8d37446f714002b8c5c4395ab82d58 and project f852e1ca6d934711942031022097eb36. Resources: {'instances', 'ram', 'cores'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Going to run 1 instances... {{(pid=65585) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:12:08 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a7f5b340-dde9-4f11-8bcb-6acd0411e24d',volume_size=None,volume_type=None)] {{(pid=65585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:12:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-9e6e2579-a28a-42eb-b521-a83d485932ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.795664 Nov 28 21:12:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 430/1283] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:12:07 2023] POST /compute/v2.1/servers => generated 404 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:12:08 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-3282290d-c067-4f38-8fef-1ea340f0412b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:12:08 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-3282290d-c067-4f38-8fef-1ea340f0412b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:12:08 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-3282290d-c067-4f38-8fef-1ea340f0412b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:12:08 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-3282290d-c067-4f38-8fef-1ea340f0412b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 200 len: 1086 microversion: 2.1 time: 0.097230 Nov 28 21:12:08 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 427/1284] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:12:08 2023] GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 1086 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:12:10 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:12:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:10 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] Creating event network-changed:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:12:10 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-024251c1-934f-4a29-afb9-bdc5988e1259 req-04d082d2-9d19-4d37-a019-ce6bac945f63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033858 Nov 28 21:12:10 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 428/1285] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:12:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "name": "network-vif-plugged", "status": "completed", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] Creating event network-vif-plugged:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:12:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-b70b1a32-b744-4fe2-97bb-6e1aac650c76 req-33ec5742-8405-4843-ac67-64eaef2b0318 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047211 Nov 28 21:12:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 431/1286] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:12:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "name": "network-vif-plugged", "status": "completed", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] Creating event network-vif-plugged:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:12:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-24a4b2cd-1b1d-488e-b37d-b04d7f24a9fc req-760dd650-6bac-413f-9287-325f0930db61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038540 Nov 28 21:12:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 428/1287] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:12:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:12:58 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:12:58 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:12:59 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:12:59 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-4ef93d29-87eb-4b60-96cf-4bb95ed7d675 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 200 len: 1439 microversion: 2.1 time: 0.239036 Nov 28 21:12:59 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 429/1288] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:12:58 2023] GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 1439 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:13:59 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:13:59 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-51c6cbe8-54fa-409d-9607-f4decd9e71ab tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 200 len: 1439 microversion: 2.1 time: 0.260313 Nov 28 21:13:59 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 432/1289] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:13:59 2023] GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 1439 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:00 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] Creating event network-changed:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:14:00 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-95c225b5-a5c1-47e3-9267-e3e2b383d18f req-d0ef6602-fb86-4091-ba64-46ad0272eff1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037241 Nov 28 21:14:00 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 429/1290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:02 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40314. Nov 28 21:14:02 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:14:02 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-b9f329dc-5ba8-4d85-8982-1a72019dbf8c tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 204 len: 0 microversion: 2.1 time: 0.176473 Nov 28 21:14:02 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 430/1291] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:14:02 2023] DELETE /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:02 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:02 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:02 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] Creating event network-changed:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:14:02 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-f857c217-07b2-40bc-9472-98615a410063 req-aa4328a6-e3b7-4c7d-a598-9229bc759f2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028535 Nov 28 21:14:02 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 430/1292] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:14:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:14:03 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:14:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-4121d743-1fbe-4b43-9234-a14d04cc1a46 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 200 len: 1563 microversion: 2.1 time: 0.317358 Nov 28 21:14:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 433/1293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:14:02 2023] GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 1563 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:14:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "name": "network-vif-unplugged", "status": "completed", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}, {"server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "name": "network-vif-plugged", "status": "completed", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}, {"server_uuid": "9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a", "name": "network-vif-deleted", "tag": "ea6d8ee8-7012-4a6f-a443-491accd499f5"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Creating event network-vif-unplugged:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:14:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Creating event network-vif-plugged:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:14:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] Creating event network-vif-deleted:ea6d8ee8-7012-4a6f-a443-491accd499f5 for instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a on user Nov 28 21:14:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-24f906cd-6b6c-4526-a861-6649b919921b req-dcd3d342-ac6f-4c1b-9538-8a66b84f3600 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.033722 Nov 28 21:14:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 431/1294] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:14:04 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:14:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a could not be found. Nov 28 21:14:53 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:14:53 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-4378486b-3c0d-45a9-8399-71215a5baced tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a" status: 404 len: 111 microversion: 2.1 time: 0.102504 Nov 28 21:14:53 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 431/1295] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:14:53 2023] GET /compute/v2.1/servers/9e0ed99a-a9d8-4bc4-aab7-7c95cb13392a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=12 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Going to try to terminate instance {{(pid=65585) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] Creating event network-changed:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:15:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-fe6323cc-490a-4e47-893b-38552097e125 req-c3ecfa2a-d81a-4d6e-8d45-9b698f468efc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095498 Nov 28 21:15:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 432/1296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:15:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:15:03 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a3872a48-03c1-4a24-bbf8-0a236c3c8e3b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 204 len: 0 microversion: 2.1 time: 0.122613 Nov 28 21:15:03 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 434/1297] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:15:03 2023] DELETE /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:03 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:04 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "name": "network-vif-unplugged", "status": "completed", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:04 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:04 user devstack@n-api.service[65586]: DEBUG nova.policy [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc8d37446f714002b8c5c4395ab82d58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f852e1ca6d934711942031022097eb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65586) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:15:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-1922b050-5b31-4bf0-bef0-316b0fbd408f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 200 len: 1562 microversion: 2.1 time: 0.286209 Nov 28 21:15:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 432/1298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:15:03 2023] GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 1562 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:15:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] Creating event network-vif-unplugged:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:15:04 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-c7caaa0b-ab1f-44b7-bbcb-db1c72291438 req-dafb07c6-f9a6-43d7-aee4-74c2849a6bcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101470 Nov 28 21:15:04 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 433/1299] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:15:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:15:05 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "name": "network-vif-deleted", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:15:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:05 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] Creating event network-vif-deleted:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:15:05 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-af986c04-6fcd-4aaf-ac61-b9b5ab5cb263 req-b3fc9aa3-5527-4032-8d85-4fbac0a562db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033039 Nov 28 21:15:05 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 435/1300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:15:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:15:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9c958cd-014c-405d-bf1c-1a44b70a8692", "name": "network-vif-plugged", "status": "completed", "tag": "16a8d2a2-3dec-4422-b70b-57c5cb01542f"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:15:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] Creating event network-vif-plugged:16a8d2a2-3dec-4422-b70b-57c5cb01542f for instance e9c958cd-014c-405d-bf1c-1a44b70a8692 on user Nov 28 21:15:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-354c8641-6951-47c8-ac08-44ab360836b8 req-67ab482c-cad3-436f-8632-7daaad9f103c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027987 Nov 28 21:15:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 433/1301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:15:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=4 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: e9c958cd-014c-405d-bf1c-1a44b70a8692] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.wsgi [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 could not be found. Nov 28 21:15:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance e9c958cd-014c-405d-bf1c-1a44b70a8692 could not be found. {{(pid=65587) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:15:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-e55db477-2cff-47e9-abc4-a9e6490cda9f tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692" status: 404 len: 111 microversion: 2.1 time: 0.035489 Nov 28 21:15:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 434/1302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:15:54 2023] GET /compute/v2.1/servers/e9c958cd-014c-405d-bf1c-1a44b70a8692 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:15:54 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.wsgi [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. Nov 28 21:15:54 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. {{(pid=65585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:15:54 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-fcb1a16e-14a3-4c0c-9967-87431cc1045a tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 404 len: 111 microversion: 2.1 time: 0.035455 Nov 28 21:15:54 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 436/1303] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:15:54 2023] DELETE /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=8 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] [instance: 86ee3671-369b-4689-aad8-6d6dae45e786] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:15:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] HTTP exception thrown: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. Nov 28 21:15:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Returning 404 to user: Instance 86ee3671-369b-4689-aad8-6d6dae45e786 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:15:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-43e0d6eb-b288-48b2-81d7-357b564b3775 tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786" status: 404 len: 111 microversion: 2.1 time: 0.033622 Nov 28 21:15:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 434/1304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:15:54 2023] GET /compute/v2.1/servers/86ee3671-369b-4689-aad8-6d6dae45e786 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:15:58 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-515750b0-9ae7-4b00-b0f3-760dfd92f71b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] Calling method '.version_select at 0x7f9e5ff930a0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:15:58 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-515750b0-9ae7-4b00-b0f3-760dfd92f71b tempest-TestVolumeBootPattern-845056434 tempest-TestVolumeBootPattern-845056434-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-71941204" status: 202 len: 0 microversion: 2.1 time: 0.026516 Nov 28 21:15:58 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 435/1305] 10.0.0.210 () {62 vars in 1334 bytes} [Tue Nov 28 21:15:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-71941204 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:17:10 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:17:10 user devstack@n-api.service[65585]: Tue Nov 28 21:17:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 28 21:17:10 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:17:10 user devstack@n-api.service[65585]: Tue Nov 28 21:17:10 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.0.0.210) !!! Nov 28 21:17:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:10 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:10 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47310. Nov 28 21:17:10 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3483b1ff-525f-4877-b69e-1f5998655d69 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: .version_select at 0x7f9e645e7910>, body: {"keypair": {"name": "tempest-keypair-1913966301", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAr3/3kAGY1yrJtzwxQ2Urupv8grxWxfpF/u1TFQl48WzhWIUqRWrpW/nMgs4CzaDQ6Au+Vx71XALuNpL3LjLE6HldOZAgZsDPEKI7G/Aa9olUjPEwHARJQi/b9eCJzdcw=="}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:17:11 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-3483b1ff-525f-4877-b69e-1f5998655d69 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting quotas for project 795b060e4d314d049bb9e866e46f6463. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:17:11 user devstack@n-api.service[65585]: DEBUG nova.quota [None req-3483b1ff-525f-4877-b69e-1f5998655d69 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting quotas for user a163fe0b8a7448dcb8363c1e3007bcc3 and project 795b060e4d314d049bb9e866e46f6463. Resources: {'key_pairs'} {{(pid=65585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:17:11 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3483b1ff-525f-4877-b69e-1f5998655d69 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370483 Nov 28 21:17:11 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 437/1306] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Nov 28 21:17:10 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1296229397", "imageRef": "77b9e284-7155-4207-b748-934c25ce18d0", "flavorRef": "1", "key_name": "tempest-keypair-1913966301", "security_groups": [{"name": "tempest-secgroup-smoke-791459058"}, {"name": "tempest-securitygroup--1336134288"}], "networks": [{"uuid": "058ee94c-09e6-41aa-ae25-ae736bac9074"}], "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.network.neutron [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] validate_networks() for [('058ee94c-09e6-41aa-ae25-ae736bac9074', None, None, None, None, None)] {{(pid=65586) validate_networks /opt/stack/nova/nova/network/neutron.py:2645}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flavor limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Image limits 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Flavor pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Image pref 0:0:0 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG nova.virt.hardware [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=65586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:17:15 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:17:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting quotas for project 795b060e4d314d049bb9e866e46f6463. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 28 21:17:16 user devstack@n-api.service[65586]: DEBUG nova.quota [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Getting quotas for user a163fe0b8a7448dcb8363c1e3007bcc3 and project 795b060e4d314d049bb9e866e46f6463. Resources: {'instances', 'ram', 'cores'} {{(pid=65586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 28 21:17:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Going to run 1 instances... {{(pid=65586) _provision_instances /opt/stack/nova/nova/compute/api.py:1404}} Nov 28 21:17:16 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='77b9e284-7155-4207-b748-934c25ce18d0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=65586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1865}} Nov 28 21:17:16 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-919ec6be-d19c-4dea-84cc-a4bcd2b190ea tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 450 microversion: 2.1 time: 1.075443 Nov 28 21:17:16 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 435/1307] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Nov 28 21:17:15 2023] POST /compute/v2.1/servers => generated 450 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Nov 28 21:17:16 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:17:16 user devstack@n-api.service[65587]: Tue Nov 28 21:17:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 (ip 10.0.0.210) !!! Nov 28 21:17:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:16 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:17:16 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-6b5b2417-526f-4bcc-a4f2-71bd45502537 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:17:16 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-6b5b2417-526f-4bcc-a4f2-71bd45502537 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:17:16 user devstack@n-api.service[65587]: DEBUG nova.policy [None req-6b5b2417-526f-4bcc-a4f2-71bd45502537 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a163fe0b8a7448dcb8363c1e3007bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795b060e4d314d049bb9e866e46f6463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65587) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:17:16 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-6b5b2417-526f-4bcc-a4f2-71bd45502537 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 200 len: 1236 microversion: 2.1 time: 0.179424 Nov 28 21:17:16 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 436/1308] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:17:16 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 1236 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:17:19 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:17:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:17:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:17:19 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:17:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] Creating event network-changed:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:17:19 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-035f30c7-5ad5-4a74-acec-7871c01d2150 req-1dd6542d-ddb0-45e9-a04c-6ef600bdcd8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149751 Nov 28 21:17:19 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 438/1309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:17:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:17:21 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "name": "network-vif-plugged", "status": "completed", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:17:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:17:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:17:21 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:17:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] Creating event network-vif-plugged:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:17:21 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-d03740a6-c2cb-44af-a505-65a72dcffd24 req-eb64c68a-a76d-42ef-ba2c-13eb777ea30f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050954 Nov 28 21:17:21 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 436/1310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:17:23 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "name": "network-vif-plugged", "status": "completed", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:17:23 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:17:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] Creating event network-vif-plugged:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:17:23 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-a8768a69-33aa-44b8-bbf6-d6a91891e613 req-fbf02f41-fd33-45fa-aadc-ec47637ae748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033516 Nov 28 21:17:23 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 437/1311] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell0:SELECT=4 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:18:06 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a163fe0b8a7448dcb8363c1e3007bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795b060e4d314d049bb9e866e46f6463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:18:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-3af23a7c-811a-4278-a0d8-bae7a4265c72 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 200 len: 1595 microversion: 2.1 time: 0.414161 Nov 28 21:18:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 439/1312] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:18:06 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 1595 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:19:06 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:19:06 user devstack@n-api.service[65586]: Tue Nov 28 21:19:06 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-interface (ip 10.0.0.210) !!! Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell0:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:06 user devstack@n-api.service[65586]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:06 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:06 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-8fe622b8-99bb-43fc-a2b9-842fb43acb0a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.161657 Nov 28 21:19:06 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 437/1313] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Nov 28 21:19:06 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-interface => generated 283 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:19:07 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:19:07 user devstack@n-api.service[65587]: Tue Nov 28 21:19:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell0:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:07 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] Creating event network-changed:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:19:07 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-9376c91f-356c-4dfc-a202-21d1566638c4 req-461c0b41-b584-46ba-96e5-cdb885453f83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047393 Nov 28 21:19:07 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 438/1314] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:07 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:08 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a163fe0b8a7448dcb8363c1e3007bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795b060e4d314d049bb9e866e46f6463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:19:08 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-d04a4fd9-a008-4cab-9860-5ddd67837c11 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 200 len: 1595 microversion: 2.1 time: 0.352975 Nov 28 21:19:08 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 440/1315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:19:07 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 1595 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7bda1af6-249a-4636-9103-4b3c00fda639"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:11 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:11 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] [f333a352-a995-475f-90f3-9f2bf85dc392] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 43358. Nov 28 21:19:11 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-730b51ea-e1d8-43ab-a139-02d35304c3e0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393995 Nov 28 21:19:11 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 438/1316] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 21:19:11 2023] POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:34 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'services' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 21:19:34 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9dbe1290-1b4f-4f4f-9e94-fdf67fccc863 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/7bda1af6-249a-4636-9103-4b3c00fda639" status: 202 len: 0 microversion: 2.1 time: 0.178890 Nov 28 21:19:34 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 439/1317] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 21:19:34 2023] DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/7bda1af6-249a-4636-9103-4b3c00fda639 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:19:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:19:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-e89ac805-a5e3-4ec9-972b-0a3abbdedfdc tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049958 Nov 28 21:19:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 441/1318] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:19:34 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 28 21:20:24 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:20:24 user devstack@n-api.service[65586]: Tue Nov 28 21:20:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=4 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:24 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:25 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-dbef74b5-c655-4d93-8a15-47f87147f917 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095248 Nov 28 21:20:25 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 439/1319] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:20:24 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 25 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 21:20:27 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:20:27 user devstack@n-api.service[65587]: Tue Nov 28 21:20:27 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments (ip 10.0.0.210) !!! Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "595acf5e-6427-43eb-ba81-ca299a7d6709"}} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:27 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:28 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-28dcf921-d139-4dce-8048-056b43ef3212 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298069 Nov 28 21:20:28 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 440/1320] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 21:20:27 2023] POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:20:39 user devstack@n-api.service[65585]: ERROR oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:39 user devstack@n-api.service[65585]: DEBUG nova.objects.instance [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'services' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=65585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 21:20:39 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-80e78454-07ae-493d-8eb6-1004544a2280 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/595acf5e-6427-43eb-ba81-ca299a7d6709" status: 202 len: 0 microversion: 2.1 time: 0.164518 Nov 28 21:20:39 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 442/1321] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 21:20:39 2023] DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/595acf5e-6427-43eb-ba81-ca299a7d6709 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:20:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:20:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-91e0b572-252e-426a-b7ef-cf6959f590c0 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Nov 28 21:20:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 440/1322] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:20:39 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:29 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:29 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-9395b05c-2472-4980-9b69-68b714455eb8 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056335 Nov 28 21:21:29 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 441/1323] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:21:29 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5aaa5a2-ff3e-484f-b6e6-670e74943438"}} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:32 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:32 user devstack@n-api.service[65585]: INFO oslo.messaging._drivers.impl_rabbit [-] [33063fe2-c351-4678-803b-2fb2afe6b785] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 36390. Nov 28 21:21:32 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-8a5e052d-0db7-4e0e-83c5-fccd18a888b4 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.378165 Nov 28 21:21:32 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 443/1324] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 21:21:32 2023] POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 194 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:21:44 user devstack@n-api.service[65586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:21:44 user devstack@n-api.service[65586]: Tue Nov 28 21:21:44 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/f5aaa5a2-ff3e-484f-b6e6-670e74943438 (ip 10.0.0.210) !!! Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:44 user devstack@n-api.service[65586]: DEBUG nova.objects.instance [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'services' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=65586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 21:21:44 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-203db78e-a48e-4d67-942c-e109c00b778a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/f5aaa5a2-ff3e-484f-b6e6-670e74943438" status: 202 len: 0 microversion: 2.1 time: 0.169476 Nov 28 21:21:44 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 441/1325] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 21:21:44 2023] DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/f5aaa5a2-ff3e-484f-b6e6-670e74943438 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:21:44 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:21:44 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-84ced361-5ca3-4a77-8614-4bf68a4c1fba tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055192 Nov 28 21:21:44 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 442/1326] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:21:44 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:34 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:34 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-940a44e9-ec38-4572-af0f-06208e5d1e8a tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.201422 Nov 28 21:22:34 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 444/1327] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:22:34 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 25 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae"}} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:37 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:37 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-fc355c2d-a045-48a2-b2c6-074fdf5fbb2b tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.401367 Nov 28 21:22:37 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 442/1328] 10.0.0.210 () {64 vars in 1400 bytes} [Tue Nov 28 21:22:37 2023] POST /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 194 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:22:48 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 28 21:22:48 user devstack@n-api.service[65587]: Tue Nov 28 21:22:48 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae (ip 10.0.0.210) !!! Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=6 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:48 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:49 user devstack@n-api.service[65587]: DEBUG nova.objects.instance [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lazy-loading 'services' on Instance uuid d3df0d93-3eb0-4397-b64f-2e6ba95313b4 {{(pid=65587) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}} Nov 28 21:22:49 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-3af664c6-7079-4ea6-89bb-162355d9ed79 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae" status: 202 len: 0 microversion: 2.1 time: 0.267881 Nov 28 21:22:49 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 443/1329] 10.0.0.210 () {62 vars in 1493 bytes} [Tue Nov 28 21:22:48 2023] DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments/0f7f7dd8-c509-4cff-a3ce-c895a3ee7fae => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:22:49 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:22:49 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-a5e41af7-ed97-4845-98a1-42712f85ba02 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051107 Nov 28 21:22:49 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 445/1330] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:22:49 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:23:39 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:23:39 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-7b4a6279-f89c-4587-8443-adf8ed52a998 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056483 Nov 28 21:23:39 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 443/1331] 10.0.0.210 () {62 vars in 1379 bytes} [Tue Nov 28 21:23:39 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 28 21:24:03 user devstack@n-api.service[65587]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=2 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65587) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:03 user devstack@n-api.service[65587]: DEBUG nova.compute.api [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Going to try to terminate instance {{(pid=65587) delete /opt/stack/nova/nova/compute/api.py:2722}} Nov 28 21:24:03 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-5cf55731-f796-42cb-a503-a3d3f4c6ac23 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 204 len: 0 microversion: 2.1 time: 0.121538 Nov 28 21:24:03 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 444/1332] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Nov 28 21:24:03 2023] DELETE /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_api:SELECT=2 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG dbcounter [-] [65585] Writing DB stats nova_cell1:SELECT=6 {{(pid=65585) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG nova.compute.api [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65585) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=6 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:04 user devstack@n-api.service[65585]: DEBUG nova.policy [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a163fe0b8a7448dcb8363c1e3007bcc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '795b060e4d314d049bb9e866e46f6463', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65585) authorize /opt/stack/nova/nova/policy.py:203}} Nov 28 21:24:04 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [None req-1794b0f9-95be-4ee3-9be0-21a3bf4d5506 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 200 len: 1720 microversion: 2.1 time: 0.370407 Nov 28 21:24:04 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 446/1333] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:24:03 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 1720 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "name": "network-vif-unplugged", "status": "completed", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:04 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.compute.server_external_events [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] Creating event network-vif-unplugged:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:24:04 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [req-daccde47-2c5d-4ae7-a06b-1ff961b3e6b3 req-42a794f9-3939-47d5-9cc4-5134f67301e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.182354 Nov 28 21:24:04 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 444/1334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:24:05 user devstack@n-api.service[65587]: INFO oslo.messaging._drivers.impl_rabbit [-] [02c59fb7-0281-4bf2-8ead-b0fdf7a84ab7] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 40120. Nov 28 21:24:05 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "name": "network-vif-deleted", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:24:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:05 user devstack@n-api.service[65587]: DEBUG oslo_concurrency.lockutils [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65587) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.compute.server_external_events [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] Creating event network-vif-deleted:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:24:05 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [req-80a1ea0d-b9e4-454f-8ef7-71aa75f10ac0 req-29aa39bc-2ee6-4970-ace1-9a9314830ee8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104474 Nov 28 21:24:05 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 445/1335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:24:06 user devstack@n-api.service[65585]: DEBUG nova.api.openstack.wsgi [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3df0d93-3eb0-4397-b64f-2e6ba95313b4", "name": "network-vif-plugged", "status": "completed", "tag": "cf1ee27c-ff8b-4fed-ad86-d44710b3276b"}]} {{(pid=65585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 28 21:24:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:06 user devstack@n-api.service[65585]: DEBUG oslo_concurrency.lockutils [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65585) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.compute.server_external_events [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] Creating event network-vif-plugged:cf1ee27c-ff8b-4fed-ad86-d44710b3276b for instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 on user Nov 28 21:24:06 user devstack@n-api.service[65585]: INFO nova.api.openstack.requestlog [req-720b0be3-2676-4d27-8e2b-a191decc8820 req-fe4f18ef-6232-4653-ad23-0802c901cca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028630 Nov 28 21:24:06 user devstack@n-api.service[65585]: [pid: 65585|app: 0|req: 447/1336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Nov 28 21:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_api:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG dbcounter [-] [65586] Writing DB stats nova_cell1:SELECT=2 {{(pid=65586) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '>' {{(pid=65586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG nova.compute.api [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] [instance: d3df0d93-3eb0-4397-b64f-2e6ba95313b4] Fetching instance by UUID {{(pid=65586) get /opt/stack/nova/nova/compute/api.py:2978}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Acquiring lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}} Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG oslo_concurrency.lockutils [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Lock "88105936-ce3a-426e-b16b-d7ab0f9004ae" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=65586) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}} Nov 28 21:24:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.wsgi [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] HTTP exception thrown: Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 could not be found. Nov 28 21:24:54 user devstack@n-api.service[65586]: DEBUG nova.api.openstack.wsgi [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Returning 404 to user: Instance d3df0d93-3eb0-4397-b64f-2e6ba95313b4 could not be found. {{(pid=65586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 28 21:24:54 user devstack@n-api.service[65586]: INFO nova.api.openstack.requestlog [None req-5203e250-05f4-4bec-a3ac-662d69d14b50 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4" status: 404 len: 111 microversion: 2.1 time: 0.037030 Nov 28 21:24:54 user devstack@n-api.service[65586]: [pid: 65586|app: 0|req: 445/1337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Nov 28 21:24:54 2023] GET /compute/v2.1/servers/d3df0d93-3eb0-4397-b64f-2e6ba95313b4 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 28 21:24:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:54 user devstack@n-api.service[65587]: DEBUG dbcounter [-] [65587] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=65587) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Nov 28 21:24:54 user devstack@n-api.service[65587]: DEBUG nova.api.openstack.wsgi [None req-88da486f-0c54-4b4e-88c7-9d36d371e595 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] Calling method '.version_select at 0x7f9e5ff939a0>' {{(pid=65587) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 28 21:24:54 user devstack@n-api.service[65587]: INFO nova.api.openstack.requestlog [None req-88da486f-0c54-4b4e-88c7-9d36d371e595 tempest-SnapshotDataIntegrityTests-1384736641 tempest-SnapshotDataIntegrityTests-1384736641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913966301" status: 202 len: 0 microversion: 2.1 time: 0.043101 Nov 28 21:24:54 user devstack@n-api.service[65587]: [pid: 65587|app: 0|req: 446/1338] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Nov 28 21:24:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913966301 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)